-- Logs begin at Mon 2022-10-31 18:41:47 UTC, end at Mon 2022-10-31 19:38:50 UTC. -- Oct 31 19:12:07.305314 dv-cinder-863097-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Oct 31 19:12:07.313893 dv-cinder-863097-1-iscsi devstack@n-api.service[103692]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 31 19:12:07.315854 dv-cinder-863097-1-iscsi devstack@n-api.service[103692]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Oct 31 19:12:07 2022] *** Oct 31 19:12:07.315854 dv-cinder-863097-1-iscsi devstack@n-api.service[103692]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 31 19:12:07.315854 dv-cinder-863097-1-iscsi devstack@n-api.service[103692]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 31 19:12:07.315854 dv-cinder-863097-1-iscsi devstack@n-api.service[103692]: nodename: dv-cinder-863097-1-iscsi Oct 31 19:12:07.315854 dv-cinder-863097-1-iscsi devstack@n-api.service[103692]: machine: x86_64 Oct 31 19:12:07.315854 dv-cinder-863097-1-iscsi devstack@n-api.service[103692]: clock source: unix Oct 31 19:12:07.315854 dv-cinder-863097-1-iscsi devstack@n-api.service[103692]: pcre jit disabled Oct 31 19:12:07.315854 dv-cinder-863097-1-iscsi devstack@n-api.service[103692]: detected number of CPU cores: 4 Oct 31 19:12:07.315854 dv-cinder-863097-1-iscsi devstack@n-api.service[103692]: current working directory: / Oct 31 19:12:07.315854 dv-cinder-863097-1-iscsi devstack@n-api.service[103692]: detected binary path: /usr/bin/uwsgi-core Oct 31 19:12:07.316559 dv-cinder-863097-1-iscsi devstack@n-api.service[103692]: your processes number limit is 47680 Oct 31 19:12:07.316559 dv-cinder-863097-1-iscsi devstack@n-api.service[103692]: your memory page size is 4096 bytes Oct 31 19:12:07.316559 dv-cinder-863097-1-iscsi devstack@n-api.service[103692]: detected max file descriptor number: 2048 Oct 31 19:12:07.316559 dv-cinder-863097-1-iscsi devstack@n-api.service[103692]: lock engine: pthread robust mutexes Oct 31 19:12:07.316559 dv-cinder-863097-1-iscsi devstack@n-api.service[103692]: thunder lock: enabled Oct 31 19:12:07.316559 dv-cinder-863097-1-iscsi devstack@n-api.service[103692]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 31 19:12:07.316559 dv-cinder-863097-1-iscsi devstack@n-api.service[103692]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 31 19:12:07.355709 dv-cinder-863097-1-iscsi devstack@n-api.service[103692]: Python main interpreter initialized at 0x56423756d9c0 Oct 31 19:12:07.355709 dv-cinder-863097-1-iscsi devstack@n-api.service[103692]: python threads support enabled Oct 31 19:12:07.355709 dv-cinder-863097-1-iscsi devstack@n-api.service[103692]: your server socket listen backlog is limited to 100 connections Oct 31 19:12:07.355709 dv-cinder-863097-1-iscsi devstack@n-api.service[103692]: your mercy for graceful operations on workers is 90 seconds Oct 31 19:12:07.356100 dv-cinder-863097-1-iscsi devstack@n-api.service[103692]: mapped 403077 bytes (393 KB) for 2 cores Oct 31 19:12:07.356100 dv-cinder-863097-1-iscsi devstack@n-api.service[103692]: *** Operational MODE: preforking *** Oct 31 19:12:07.356356 dv-cinder-863097-1-iscsi devstack@n-api.service[103692]: *** uWSGI is running in multiple interpreter mode *** Oct 31 19:12:07.356356 dv-cinder-863097-1-iscsi devstack@n-api.service[103692]: spawned uWSGI master process (pid: 103692) Oct 31 19:12:07.356526 dv-cinder-863097-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Oct 31 19:12:07.358088 dv-cinder-863097-1-iscsi devstack@n-api.service[103692]: spawned uWSGI worker 1 (pid: 103693, cores: 1) Oct 31 19:12:07.358088 dv-cinder-863097-1-iscsi devstack@n-api.service[103692]: spawned uWSGI worker 2 (pid: 103694, cores: 1) Oct 31 19:12:07.358415 dv-cinder-863097-1-iscsi devstack@n-api.service[103692]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 31 19:12:08.013274 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 31 19:12:08.013921 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 31 19:12:09.084903 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 31 19:12:09.084903 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: from cryptography.utils import int_from_bytes Oct 31 19:12:09.085459 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 31 19:12:09.085459 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: from cryptography.utils import int_from_bytes Oct 31 19:12:09.086617 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 31 19:12:09.086617 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: from cryptography.utils import int_from_bytes Oct 31 19:12:09.087037 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 31 19:12:09.087037 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: from cryptography.utils import int_from_bytes Oct 31 19:12:11.561484 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 31 19:12:11.562065 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 31 19:12:11.562274 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 31 19:12:11.562635 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 31 19:12:11.562889 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 31 19:12:11.563271 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.563355 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 31 19:12:11.563693 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 31 19:12:11.563785 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.563907 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.564068 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 31 19:12:11.564222 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.564440 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 31 19:12:11.564586 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.564677 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 31 19:12:11.564843 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.565071 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.565166 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.565399 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.565495 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.565754 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.565859 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.566051 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.566142 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.566381 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.566467 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.566690 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-863097-1-iscsi {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.566785 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.567012 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.567100 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.567318 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.567411 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.567629 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.567716 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.567897 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.567992 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.568270 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.568357 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.568601 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.568694 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-863097-1-iscsi {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.568905 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.569004 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.569229 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.569408 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.569524 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.570543 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.570654 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.570654 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.570775 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.570775 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.570888 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.570888 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.571009 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.571081 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.571275 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.571373 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.571588 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.571684 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.571897 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.571983 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.572228 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.572393 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.572605 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.572800 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.572958 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.573176 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-863097-1-iscsi {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.573326 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.573546 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.573699 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.573877 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.574053 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.574270 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.574425 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.574640 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.574795 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.575012 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.575203 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-863097-1-iscsi {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.575366 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.575523 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.575690 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.575818 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.575948 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.576114 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.576238 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.576359 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.576480 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.576609 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.576738 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.576896 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.577019 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.577140 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.577261 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.577390 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.577518 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.577681 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.577805 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.577932 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.578054 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.578245 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.578372 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.578547 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.578670 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.578851 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.578975 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.579105 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.579227 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.579391 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.579602 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.579738 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.579870 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.580017 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.580153 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.580339 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.580468 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.580589 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.580720 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.580900 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.581036 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.581158 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.581288 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.581419 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.581548 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.581761 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.581888 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.582068 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.582204 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.582374 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.582506 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.582638 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.582760 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.582931 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.583071 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.583256 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.583385 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.583564 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.584252 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.584387 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.584523 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.584691 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.584822 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.585000 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.585126 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.585308 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.585518 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.585662 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.585798 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.585921 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.586041 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.586233 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.586434 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.586570 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.586700 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.586854 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.586979 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.587314 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.587442 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.587548 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.587651 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.587770 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.587897 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.588087 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.588214 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.588403 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.588537 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.588709 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.588841 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.589015 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.589142 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.589320 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.589451 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.589655 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.589797 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.589981 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.590105 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.590282 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.590406 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.590537 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.590670 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.590816 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.590948 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.591120 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.591256 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.591437 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.591569 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.591740 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.591866 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.592043 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.592169 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.592348 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.592480 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.592645 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.592782 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.592948 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.593075 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.593249 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.593382 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.593559 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.593721 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.593890 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.594022 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.594192 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.594325 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.594491 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.594615 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.594795 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.594927 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.595100 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.595224 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.595402 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.595525 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.595708 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.595831 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.596017 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.596142 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.596329 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.596463 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.596635 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.596758 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.596940 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.597068 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.597244 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.597378 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.597544 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.597703 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.597875 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.598000 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.598187 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.598310 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.598491 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.598617 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.598798 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.598923 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.599100 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.599224 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.599972 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.600100 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.600293 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.600430 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.600601 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.600728 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.600906 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.601032 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.601224 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.601350 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.601525 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.601717 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.601842 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.601962 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.602159 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.602285 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.602467 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.602590 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.602771 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.602909 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.603073 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.603199 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.603381 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.603506 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.603686 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.603819 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.603987 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.604112 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.604289 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.604423 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.604593 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.604748 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.604892 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.605017 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.605195 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.605330 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.605503 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.605683 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.605836 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.605977 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.606138 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.606255 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.606441 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.606568 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.606743 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.606866 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.607062 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.607188 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.607385 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.607512 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.607697 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.607829 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.608006 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.608131 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.608313 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.608439 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.608634 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:12:11.608760 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.608961 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.609085 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.609273 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.609400 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.609586 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.609730 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.609934 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.610074 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.610247 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.610373 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.610557 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.610684 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.610867 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.611009 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.611184 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.611316 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.611501 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.611627 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.611830 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.611963 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.612142 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.612346 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.612484 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.612606 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.612752 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.612887 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.613060 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.613186 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.613378 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.613501 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.613728 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.613867 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.614047 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.614178 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.614355 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.614485 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.614671 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.614804 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.615030 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.615156 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.615343 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.615467 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.615668 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.615797 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.615988 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.616113 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.616298 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.616424 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.616607 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.616733 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.616916 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.617035 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.617253 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.617379 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.617564 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.617739 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.617900 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.618102 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.618240 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.618362 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.618499 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.618622 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.618813 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.618947 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.619127 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.619260 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.619437 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.619563 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.619748 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.619874 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.620058 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.620194 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.620367 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.620500 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.620691 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.620823 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.621002 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.621136 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.621314 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.621446 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.621645 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.621772 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.621962 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.622099 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.622275 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.622400 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.622584 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.622710 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.622891 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.623018 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.623198 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.623323 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.623506 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.623638 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.623807 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.623941 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.624111 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.624238 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.624417 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.624542 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.624718 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.624845 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.625027 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.625151 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.625336 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.625462 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.625661 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.625789 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.625970 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.626097 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.626287 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.626413 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.626592 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.626717 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.626897 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.627022 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.627205 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.627339 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.627509 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.627635 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.627816 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.627949 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.628123 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.628261 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.628428 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.628588 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.628736 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.628860 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.629045 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.629178 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.629346 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.629473 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.629684 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.629812 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.629988 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.630125 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.630292 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.630414 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.630631 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.630754 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.630940 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.631067 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.631246 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.631369 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.631553 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.631677 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.631863 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.632000 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.632169 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.632293 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.632481 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.632607 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.632792 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.632928 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.633101 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.633225 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.633413 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.633563 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.633755 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.633883 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.634076 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.634202 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.634389 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.634522 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.634700 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.634834 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.635002 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.635134 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.635309 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.635516 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.635641 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.635763 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.635891 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.636014 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.636189 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.636329 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.636494 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.636620 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.636794 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.636921 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.637098 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.637225 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.637399 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.637532 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.637787 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.637913 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.638096 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.638231 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.638406 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.638536 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.638711 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.638836 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.639011 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.639135 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.639312 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.639438 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.639615 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.639746 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.639920 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.640048 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.640243 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.640366 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.640551 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.640684 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.640855 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.640992 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.641159 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.641285 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.641462 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.641596 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.641828 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.641966 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.642136 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.642262 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.642443 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.642575 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.642752 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.642878 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.643061 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.643187 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.643375 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.643510 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.643694 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.643820 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.644003 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.644130 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.644314 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.644475 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.644620 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.644750 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.644928 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.645052 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.645235 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.645359 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.645550 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.645693 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.645880 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.646007 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.646714 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.646842 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.647025 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.647149 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.647351 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.647477 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.647663 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.647789 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.647981 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.648104 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.648286 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.648411 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.648598 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.648722 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.648904 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.649029 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.649213 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.649346 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.649520 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.649688 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.649853 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.649983 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.650169 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.650311 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.650477 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.650601 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.650793 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.650917 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.651101 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.651234 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.651409 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.651534 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.651714 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.651837 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.652029 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.652166 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.652332 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.652458 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.652644 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.652769 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.652952 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.653083 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.653277 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.653408 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.653582 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.653728 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.653919 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.654046 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.654221 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.654353 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.654533 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.654658 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.654840 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.654974 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.655148 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.655274 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.655453 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.655578 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.655756 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.655889 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.656065 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.656190 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.656376 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.656501 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.656682 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.656808 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.656990 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.657121 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.657290 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.657416 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.657595 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.657759 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.657924 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.658048 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.658225 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.658361 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.658526 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.658652 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.658834 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.658960 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.659139 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.659272 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.659452 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.659575 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.659757 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.659883 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.660064 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.660199 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.660364 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.660488 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.660665 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.660798 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.660985 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.661125 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.661292 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.661421 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.661905 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.662039 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.662215 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.662334 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.662516 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.662649 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.662855 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.662981 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.663161 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.663287 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.663464 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.663590 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.663768 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.663892 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.664073 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.664207 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.664380 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.664506 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.664689 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.664890 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.665016 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.665139 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.665289 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.665424 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.665639 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.665781 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.665943 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.666068 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.666249 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.666374 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.666558 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.666705 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.666864 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.666991 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.667173 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.667297 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.667477 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.667610 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.667797 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.667921 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.668103 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.668228 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.668412 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.668538 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.668721 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.668853 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.669023 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.669148 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.669331 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.669469 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.669662 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.669790 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.669982 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.670227 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.670370 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.670561 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.670687 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.670877 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.671002 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.671185 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.671317 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.671506 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.671640 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.671839 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.672078 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.672205 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.672419 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.672553 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.672739 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.672864 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.673063 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.673192 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.673377 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.673515 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.673707 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.673845 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.674021 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.674154 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.674332 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.674459 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.674637 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.674763 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.674941 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.675067 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.675245 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.675384 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.675553 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.675680 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.675856 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.675982 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.676158 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.676297 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.676461 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.676587 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.676763 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.676896 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.677068 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.677201 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.677903 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.678035 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.678218 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.678342 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.678521 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.678655 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.678826 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.678950 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.679135 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.679261 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.679438 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.679562 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.679740 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.679866 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.680044 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.680178 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.680348 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.680473 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.680674 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.680799 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.680986 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.681112 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.681294 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.681421 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.681600 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.681750 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.681931 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.682065 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.682258 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.682383 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.682581 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.682704 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.682885 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.683018 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.683192 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.683317 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.683495 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.683621 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.683806 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.683940 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.684117 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.684249 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.684430 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.684559 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.684741 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.684875 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.685050 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.685176 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.685353 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.685477 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.685683 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.685824 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.685990 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.686125 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.686299 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.686432 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.686603 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.686736 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.686914 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.687037 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.687220 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.687345 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.687523 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.687650 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.687827 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.687950 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.688134 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.688259 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.688438 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.688569 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.688739 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.688874 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.689046 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.689172 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.689377 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.689501 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.689658 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.689782 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.689962 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.690100 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.690265 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.690389 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.690568 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.690701 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.690877 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.691009 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.691182 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.691300 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.691482 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.691606 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.691790 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.691923 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.692097 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.692223 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.692400 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.692523 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.692702 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.692837 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.693058 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.693183 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.693366 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.693501 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.693694 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.693823 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.694006 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.694130 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.694313 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.694437 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.694622 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.694749 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.694928 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.695052 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.695233 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.695358 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.695533 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.695659 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.695834 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.695960 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.696137 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.696263 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.696444 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.696571 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.696746 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.696871 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.697046 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.697182 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.697347 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.697472 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.697666 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.697807 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.697972 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.698111 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.698278 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.698402 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.698583 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.698711 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.698883 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.699016 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.699185 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.699309 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.699483 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.699606 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.699784 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.699917 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.700108 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.700234 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.700420 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.700544 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.700725 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.700852 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.701032 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.701157 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.701336 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.701461 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.701673 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.701812 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.701984 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.702110 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.702296 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.702430 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.702598 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.702725 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.702911 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.703030 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.703219 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.703344 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.703529 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.703656 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.703833 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.703960 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.704133 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.704258 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.704448 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.704572 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.704756 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.704879 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.705067 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.705199 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.705379 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.705505 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.705708 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.705836 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.706014 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.706158 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.706323 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.706446 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.706631 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.706756 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.706940 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.707073 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.707248 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.707371 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.707559 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.707684 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.707867 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.708002 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.708176 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.708301 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.708485 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.709093 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.709307 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.709432 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.709656 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.709786 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.709950 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.710090 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.710255 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.710381 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.710563 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.710696 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.710871 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.710997 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.711173 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.711300 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.711481 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.711603 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.711790 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.711914 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.712092 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.712219 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.712398 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.712531 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.712699 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.712826 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.713004 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.713121 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.713307 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.713433 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.713632 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.713771 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.713948 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.714073 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.714260 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.714385 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.714564 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.714698 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.714876 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.715002 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.715182 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.715308 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.715530 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.715667 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.715842 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.715967 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.716146 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.716271 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.716501 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.716626 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.716813 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.716938 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.717126 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.717252 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.717439 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.717565 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.717767 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.717893 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.718070 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.718189 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.718385 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.718517 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.718691 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.718818 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.718995 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.719120 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.719298 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.719423 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.719600 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.719725 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.719919 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.720057 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.720226 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.720351 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.720546 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.720671 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.720879 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.721014 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.721188 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.721374 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.721499 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.721665 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.721830 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.721970 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.722138 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.722264 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.722462 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.722588 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.722875 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.723007 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.723186 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.723309 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.723496 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.723646 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.723802 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.723937 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.724112 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.724302 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.724482 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.724608 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.724812 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.724948 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.725135 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.725261 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.725445 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.725572 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.725785 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.725911 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.726092 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.726219 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.726412 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.726546 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.726733 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.726858 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.727044 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.727178 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.727366 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.727489 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.727683 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.727808 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.727992 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.728119 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.728318 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.728444 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.728643 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.728848 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.728974 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.729109 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.729270 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.729396 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.729575 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.729742 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.729910 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.730035 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.730213 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.730339 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.730515 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.730651 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.730836 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.730962 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.731140 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.731268 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.731448 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.731584 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.731756 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.731881 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.732061 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.732186 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.732362 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.732489 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.732663 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.732788 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.732982 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.733108 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.733286 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.733413 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.733625 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.733754 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.733941 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.734064 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.734248 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.734385 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.734555 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.734688 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.734864 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.734988 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.735172 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.735305 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.735478 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.735602 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.735779 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.735913 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.736080 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.736206 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.736380 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.736507 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.736716 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.736850 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.737017 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.737142 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.737334 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.737461 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.737668 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.737813 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.737982 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.738108 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.738291 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.738417 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.738621 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.738755 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.738934 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.739058 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.739249 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.739374 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.739555 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.739682 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.739918 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.740060 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.740240 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.740372 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.740542 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.740676 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.740846 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.740972 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.741153 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.741279 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.741455 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.741581 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.741781 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.741908 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.742085 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.742211 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.742390 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.742526 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.742689 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.742816 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.742990 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.743118 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.743292 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.743411 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.743611 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.743737 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.743912 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.744051 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.744218 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.744344 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.744523 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.744649 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.744826 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.744960 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.745127 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.745251 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.745427 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.745552 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.745767 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.745908 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.746079 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.746204 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.746390 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.746524 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.746697 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.746824 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.747004 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.747130 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.747310 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.747436 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.747619 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.747757 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.747930 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.748064 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.748240 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.748365 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.748551 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.748685 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.748863 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.748996 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.749172 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.749298 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.749479 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.749656 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.749816 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.749941 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.750125 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.750264 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.750437 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.750569 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.750751 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.750948 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.751081 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.751278 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.751404 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.751591 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.751717 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.751901 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.752026 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.752210 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.752337 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.752519 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.752771 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.752905 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.753110 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.753243 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.753418 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.753534 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.753754 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.753880 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.754061 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.754186 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.754373 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.754504 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.754688 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.754812 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.754999 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.755124 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.755313 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.755440 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.756152 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.756293 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.756465 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.756596 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.756776 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.756903 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.757085 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.757225 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.757414 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.757539 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.757763 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.757888 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.758088 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.758213 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.758364 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.758492 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.758676 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.758809 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.758985 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.759112 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.759291 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.759418 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.759598 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.759723 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.759908 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.760035 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.760217 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.760343 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.760524 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.760659 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.760831 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.760957 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.761138 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.761264 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.761447 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.761580 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.761784 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.761910 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.762099 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.762225 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.762411 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.762550 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.762721 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.762845 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.763031 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.763168 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.763344 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.763469 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.763665 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.763862 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.763989 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.764182 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.764320 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.764515 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.764641 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.764842 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.764968 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.765167 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.765302 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.765487 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.765746 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.765887 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.766068 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.766194 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.766404 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.766533 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.766732 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.766860 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.767058 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.767193 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.767363 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.767488 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.767669 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.767796 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.767989 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.768124 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.768293 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.768418 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.768595 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.768720 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.768902 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.769036 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.769205 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.769330 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.769508 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.769754 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.769895 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.770095 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.770229 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.770409 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.770535 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.771065 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.771257 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.771375 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.771482 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.771586 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.771712 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.772107 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.772360 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.772519 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.772673 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.772825 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.772986 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.773125 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.773245 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.773440 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.773563 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.775910 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.776074 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.776227 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.776358 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.776472 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.776598 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.776598 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.776831 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.776964 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.777088 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.777210 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.777333 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.777455 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.777576 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.777743 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.777867 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.777990 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.778111 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.778234 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.778357 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.778488 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.778610 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.778732 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.778853 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.778974 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.779104 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.779236 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.779358 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.779480 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.779610 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.779732 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.779862 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.779984 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.780105 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.780227 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.780348 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.780470 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.780601 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.780724 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.780845 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.780845 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.781080 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.781202 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.781338 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.781469 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.781592 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.781742 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.781864 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.782003 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.782145 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.782263 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.782383 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.782504 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.782626 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.782756 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.782878 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.782998 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.783120 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.783120 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.783356 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.783486 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.783609 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.783609 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.783844 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.783972 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.784097 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.784228 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.784350 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.784472 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.784600 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.784723 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.784856 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.784978 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.785099 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.785220 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.785341 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.785462 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.785591 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.785731 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.785853 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.785985 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.786145 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.786271 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.786466 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.787529 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.787659 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.787863 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.787997 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.788172 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.788380 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.788505 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.788627 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.788776 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.788903 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.789082 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.789209 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.789389 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.789515 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.789719 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.789847 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.790029 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.790155 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.790336 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.790461 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.790643 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.790768 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.790949 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.791076 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.791256 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.791389 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.791965 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.792096 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.792203 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.792308 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.792308 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.792503 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.792607 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.792721 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.792827 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.792930 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.793069 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.793183 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.793382 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.793504 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.793713 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.793826 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.794025 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.794138 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.794334 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.794462 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.794640 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.794752 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.794953 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.795065 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.795280 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.795395 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.795595 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.795707 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.795904 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.796025 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.796256 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.796520 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.796646 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.796834 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.796961 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.797146 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.797283 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.797457 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.797594 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.797801 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.797942 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.798138 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.798267 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.798458 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.798589 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.798767 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.798903 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.799155 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.799457 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.799584 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.799774 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.799899 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.800100 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.800226 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.800427 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.800561 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.800742 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.800879 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.801049 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.801173 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.801354 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.801481 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.801691 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.801833 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.802006 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.802132 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.802341 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.802996 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.803175 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.803310 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.803481 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.803609 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.803785 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.803911 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.804094 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.804228 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.804397 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.804523 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.804700 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.804826 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.805002 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.805130 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.805303 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.805437 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.805644 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.805776 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.805936 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.806064 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.806238 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.806372 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.806541 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.806670 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.806844 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.806971 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.807144 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.807278 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.807444 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.807580 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.807750 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.807886 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.808053 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.808179 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.808356 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.808492 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.808656 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.808784 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.808957 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.809083 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.809259 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.809393 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.809566 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.809713 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.809894 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.810024 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.810199 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.810336 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.810508 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.810642 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.810814 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.810941 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.811121 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.811249 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.811426 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.811594 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.811726 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.811849 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.812022 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.812149 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.812356 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.812483 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.812664 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.812789 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.812994 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.813120 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.813301 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.813425 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.813651 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.813783 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.813929 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.814056 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.814239 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.814366 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.814549 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.814689 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.814859 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.814985 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.815168 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.815295 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.815479 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.815612 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.815787 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.815911 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.816110 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.816235 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.816424 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.816559 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.816737 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.816863 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.817049 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.817185 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.817386 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.817510 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.817681 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.817808 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.818018 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.818148 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.818322 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.818452 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.818634 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.818762 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.818944 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.819071 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.819252 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.819381 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.819566 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.819694 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.819873 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.820008 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.820180 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.820309 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.820493 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.820627 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.820813 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.820984 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.821110 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.821242 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.821406 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.821533 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.821746 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.821888 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.822061 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.822188 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.822379 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.822508 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.822690 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.822826 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.823002 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.823128 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.823318 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.823447 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.823631 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.823766 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.823960 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.824087 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.824267 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.824385 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.824571 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.824699 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.824831 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 31 19:12:11.824961 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.825225 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.825576 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.825913 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.826259 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.826591 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.826910 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.827225 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.827535 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:12:11.827780 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 31 19:12:11.977698 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: INFO dbcounter [None req-78c2b368-19df-4d9e-9cf4-3074782c43ea None None] Registered counter for database nova_api Oct 31 19:12:11.981008 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: INFO dbcounter [None req-1e80fb1f-ece3-4d01-8509-978d3d00210a None None] Registered counter for database nova_api Oct 31 19:12:11.998368 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG oslo_db.sqlalchemy.engines [None req-78c2b368-19df-4d9e-9cf4-3074782c43ea None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103694) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 31 19:12:12.001312 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG oslo_db.sqlalchemy.engines [None req-1e80fb1f-ece3-4d01-8509-978d3d00210a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103693) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 31 19:12:12.005215 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG dbcounter [-] [103694] Writer thread running {{(pid=103694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 31 19:12:12.008404 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG dbcounter [-] [103693] Writer thread running {{(pid=103693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 31 19:12:12.061181 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.context [None req-78c2b368-19df-4d9e-9cf4-3074782c43ea None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c28e7eb5-b4d6-491e-b19a-55ca88f41a3d(cell1) {{(pid=103694) load_cells /opt/stack/nova/nova/context.py:464}} Oct 31 19:12:12.064147 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.context [None req-1e80fb1f-ece3-4d01-8509-978d3d00210a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c28e7eb5-b4d6-491e-b19a-55ca88f41a3d(cell1) {{(pid=103693) load_cells /opt/stack/nova/nova/context.py:464}} Oct 31 19:12:12.065041 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG oslo_concurrency.lockutils [None req-78c2b368-19df-4d9e-9cf4-3074782c43ea None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:12:12.065514 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG oslo_concurrency.lockutils [None req-78c2b368-19df-4d9e-9cf4-3074782c43ea None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:12:12.067107 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG oslo_concurrency.lockutils [None req-78c2b368-19df-4d9e-9cf4-3074782c43ea None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:12:12.067816 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG oslo_concurrency.lockutils [None req-78c2b368-19df-4d9e-9cf4-3074782c43ea None None] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:12:12.068443 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG oslo_concurrency.lockutils [None req-1e80fb1f-ece3-4d01-8509-978d3d00210a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:12:12.068780 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG oslo_concurrency.lockutils [None req-78c2b368-19df-4d9e-9cf4-3074782c43ea None None] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:12:12.068930 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG oslo_concurrency.lockutils [None req-1e80fb1f-ece3-4d01-8509-978d3d00210a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:12:12.070554 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG oslo_concurrency.lockutils [None req-1e80fb1f-ece3-4d01-8509-978d3d00210a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:12:12.070814 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG oslo_concurrency.lockutils [None req-78c2b368-19df-4d9e-9cf4-3074782c43ea None None] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:12:12.071267 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG oslo_concurrency.lockutils [None req-1e80fb1f-ece3-4d01-8509-978d3d00210a None None] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:12:12.071709 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG oslo_concurrency.lockutils [None req-1e80fb1f-ece3-4d01-8509-978d3d00210a None None] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:12:12.072789 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: INFO dbcounter [None req-78c2b368-19df-4d9e-9cf4-3074782c43ea None None] Registered counter for database nova_cell0 Oct 31 19:12:12.073747 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG oslo_concurrency.lockutils [None req-1e80fb1f-ece3-4d01-8509-978d3d00210a None None] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:12:12.075821 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: INFO dbcounter [None req-1e80fb1f-ece3-4d01-8509-978d3d00210a None None] Registered counter for database nova_cell0 Oct 31 19:12:12.076878 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: INFO dbcounter [None req-78c2b368-19df-4d9e-9cf4-3074782c43ea None None] Registered counter for database nova_cell1 Oct 31 19:12:12.079977 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: INFO dbcounter [None req-1e80fb1f-ece3-4d01-8509-978d3d00210a None None] Registered counter for database nova_cell1 Oct 31 19:12:12.084676 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG oslo_db.sqlalchemy.engines [None req-78c2b368-19df-4d9e-9cf4-3074782c43ea None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103694) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 31 19:12:12.086847 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG oslo_db.sqlalchemy.engines [None req-78c2b368-19df-4d9e-9cf4-3074782c43ea None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103694) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 31 19:12:12.088550 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG oslo_db.sqlalchemy.engines [None req-1e80fb1f-ece3-4d01-8509-978d3d00210a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103693) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 31 19:12:12.090233 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG oslo_db.sqlalchemy.engines [None req-1e80fb1f-ece3-4d01-8509-978d3d00210a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103693) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 31 19:12:12.091958 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG dbcounter [-] [103694] Writer thread running {{(pid=103694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 31 19:12:12.094822 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG dbcounter [-] [103694] Writer thread running {{(pid=103694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 31 19:12:12.096084 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG dbcounter [-] [103693] Writer thread running {{(pid=103693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 31 19:12:12.098349 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG dbcounter [-] [103693] Writer thread running {{(pid=103693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 31 19:12:12.235937 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: INFO dbcounter [None req-78c2b368-19df-4d9e-9cf4-3074782c43ea None None] Registered counter for database nova_cell0 Oct 31 19:12:12.240708 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: INFO dbcounter [None req-1e80fb1f-ece3-4d01-8509-978d3d00210a None None] Registered counter for database nova_cell0 Oct 31 19:12:12.245281 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG oslo_db.sqlalchemy.engines [None req-78c2b368-19df-4d9e-9cf4-3074782c43ea None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103694) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 31 19:12:12.247816 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG oslo_db.sqlalchemy.engines [None req-1e80fb1f-ece3-4d01-8509-978d3d00210a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103693) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 31 19:12:12.249903 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG dbcounter [-] [103694] Writer thread running {{(pid=103694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 31 19:12:12.252102 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG dbcounter [-] [103693] Writer thread running {{(pid=103693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 31 19:12:12.587850 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: WARNING keystonemiddleware.auth_token [None req-1e80fb1f-ece3-4d01-8509-978d3d00210a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 31 19:12:12.588480 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: WARNING keystonemiddleware.auth_token [None req-78c2b368-19df-4d9e-9cf4-3074782c43ea None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 31 19:12:12.595074 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: WARNING keystonemiddleware.auth_token [None req-1e80fb1f-ece3-4d01-8509-978d3d00210a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 31 19:12:12.595206 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: WARNING keystonemiddleware.auth_token [None req-78c2b368-19df-4d9e-9cf4-3074782c43ea None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 31 19:12:12.936114 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: WARNING keystonemiddleware.auth_token [None req-78c2b368-19df-4d9e-9cf4-3074782c43ea None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 31 19:12:12.936641 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: WARNING keystonemiddleware.auth_token [None req-1e80fb1f-ece3-4d01-8509-978d3d00210a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 31 19:12:12.942012 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: WARNING keystonemiddleware.auth_token [None req-78c2b368-19df-4d9e-9cf4-3074782c43ea None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 31 19:12:12.942541 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: WARNING keystonemiddleware.auth_token [None req-1e80fb1f-ece3-4d01-8509-978d3d00210a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 31 19:12:12.947364 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x56423756d9c0 pid: 103694 (default app) Oct 31 19:12:12.947832 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x56423756d9c0 pid: 103693 (default app) Oct 31 19:12:12.949402 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi [None req-78c2b368-19df-4d9e-9cf4-3074782c43ea None None] Calling method '>' {{(pid=103694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:12:12.950643 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: INFO nova.api.openstack.requestlog [None req-78c2b368-19df-4d9e-9cf4-3074782c43ea None None] 10.222.0.16 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001761 Oct 31 19:12:12.951043 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: [pid: 103694|app: 0|req: 1/1] 10.222.0.16 () {50 vars in 788 bytes} [Mon Oct 31 19:12:12 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:13:33.374375 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi [None req-1e80fb1f-ece3-4d01-8509-978d3d00210a None None] Calling method '>' {{(pid=103693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:13:33.375618 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: INFO nova.api.openstack.requestlog [None req-1e80fb1f-ece3-4d01-8509-978d3d00210a None None] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002003 Oct 31 19:13:33.376013 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: [pid: 103693|app: 0|req: 1/2] 10.222.0.16 () {54 vars in 931 bytes} [Mon Oct 31 19:13:33 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:13:33.391499 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG dbcounter [-] [103694] Writing DB stats nova_api:SELECT=3 {{(pid=103694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:13:33.393986 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG dbcounter [-] [103694] Writing DB stats nova_cell0:SELECT=3 {{(pid=103694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:13:33.395068 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG dbcounter [-] [103694] Writing DB stats nova_cell1:SELECT=3 {{(pid=103694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:13:33.397245 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG dbcounter [-] [103694] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:13:34.268038 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi [None req-510cb3bc-8c2b-4fd5-a1fb-b18e6ade0fc5 admin admin] Calling method '>' {{(pid=103694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:13:34.302079 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: INFO nova.api.openstack.requestlog [None req-510cb3bc-8c2b-4fd5-a1fb-b18e6ade0fc5 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.919501 Oct 31 19:13:34.302818 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: [pid: 103694|app: 0|req: 2/3] 10.222.0.16 () {60 vars in 1292 bytes} [Mon Oct 31 19:13:33 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:13:36.917055 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi [None req-1e80fb1f-ece3-4d01-8509-978d3d00210a None None] Calling method '>' {{(pid=103693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:13:36.918097 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: INFO nova.api.openstack.requestlog [None req-1e80fb1f-ece3-4d01-8509-978d3d00210a None None] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Oct 31 19:13:36.918685 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: [pid: 103693|app: 0|req: 2/4] 10.222.0.16 () {54 vars in 931 bytes} [Mon Oct 31 19:13:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:13:37.375316 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi [None req-8bd69892-3134-4b43-808c-134737485c5b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 1, "disk": 1, "id": "c1", "swap": 0, "ram": 256}} {{(pid=103694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:13:37.422585 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: INFO nova.api.openstack.requestlog [None req-8bd69892-3134-4b43-808c-134737485c5b admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.497942 Oct 31 19:13:37.423395 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: [pid: 103694|app: 0|req: 3/5] 10.222.0.16 () {64 vars in 1283 bytes} [Mon Oct 31 19:13:36 2022] POST /compute/v2.1/flavors => generated 407 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 31 19:13:37.436689 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG dbcounter [-] [103693] Writing DB stats nova_api:SELECT=3 {{(pid=103693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:13:37.437505 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG dbcounter [-] [103693] Writing DB stats nova_cell1:SELECT=3 {{(pid=103693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:13:37.439998 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG dbcounter [-] [103693] Writing DB stats nova_cell0:SELECT=3 {{(pid=103693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:13:37.440725 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG dbcounter [-] [103693] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:13:37.643608 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi [None req-b0c68b83-302d-4f90-b0d1-0bdb7caf2e25 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:13:37.712599 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: INFO nova.api.openstack.requestlog [None req-b0c68b83-302d-4f90-b0d1-0bdb7caf2e25 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.281060 Oct 31 19:13:37.713191 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: [pid: 103693|app: 0|req: 3/6] 10.222.0.16 () {64 vars in 1336 bytes} [Mon Oct 31 19:13:37 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:13:40.308357 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi [None req-8bd69892-3134-4b43-808c-134737485c5b admin admin] Calling method '>' {{(pid=103694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:13:40.309998 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: INFO nova.api.openstack.requestlog [None req-8bd69892-3134-4b43-808c-134737485c5b admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002048 Oct 31 19:13:40.310394 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: [pid: 103694|app: 0|req: 4/7] 10.222.0.16 () {54 vars in 931 bytes} [Mon Oct 31 19:13:40 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:13:40.995647 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi [None req-b54f32d6-c222-43a4-b737-cff69d382854 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "name": "ds512M", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 512, "swap": 0, "id": "d1", "vcpus": 1, "rxtx_factor": 1.0}} {{(pid=103693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:13:41.038754 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: INFO nova.api.openstack.requestlog [None req-b54f32d6-c222-43a4-b737-cff69d382854 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.721612 Oct 31 19:13:41.039309 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: [pid: 103693|app: 0|req: 4/8] 10.222.0.16 () {64 vars in 1283 bytes} [Mon Oct 31 19:13:40 2022] POST /compute/v2.1/flavors => generated 404 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 31 19:13:41.052819 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi [None req-742b29e8-b282-484b-b34b-1aa976c68cd5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:13:41.094905 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: INFO nova.api.openstack.requestlog [None req-742b29e8-b282-484b-b34b-1aa976c68cd5 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.046007 Oct 31 19:13:41.095616 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: [pid: 103694|app: 0|req: 5/9] 10.222.0.16 () {64 vars in 1336 bytes} [Mon Oct 31 19:13:41 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:13:43.698748 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi [None req-b54f32d6-c222-43a4-b737-cff69d382854 admin admin] Calling method '>' {{(pid=103693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:13:43.699766 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: INFO nova.api.openstack.requestlog [None req-b54f32d6-c222-43a4-b737-cff69d382854 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001501 Oct 31 19:13:43.700171 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: [pid: 103693|app: 0|req: 5/10] 10.222.0.16 () {54 vars in 931 bytes} [Mon Oct 31 19:13:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:13:44.113367 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi [None req-96368401-e5ac-4875-b88e-c66d346cdf8e admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "name": "ds1G", "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "id": "d2", "rxtx_factor": 1.0, "vcpus": 1}} {{(pid=103694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:13:44.136172 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: INFO nova.api.openstack.requestlog [None req-96368401-e5ac-4875-b88e-c66d346cdf8e admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.428461 Oct 31 19:13:44.136733 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: [pid: 103694|app: 0|req: 6/11] 10.222.0.16 () {64 vars in 1283 bytes} [Mon Oct 31 19:13:43 2022] POST /compute/v2.1/flavors => generated 404 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 31 19:13:44.149175 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi [None req-37bcda85-e9b7-4fad-a5ee-2b17c0654b43 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:13:44.181535 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: INFO nova.api.openstack.requestlog [None req-37bcda85-e9b7-4fad-a5ee-2b17c0654b43 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035294 Oct 31 19:13:44.181535 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: [pid: 103693|app: 0|req: 6/12] 10.222.0.16 () {64 vars in 1336 bytes} [Mon Oct 31 19:13:44 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:13:46.776369 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi [None req-96368401-e5ac-4875-b88e-c66d346cdf8e admin admin] Calling method '>' {{(pid=103694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:13:46.777967 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: INFO nova.api.openstack.requestlog [None req-96368401-e5ac-4875-b88e-c66d346cdf8e admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002070 Oct 31 19:13:46.778630 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: [pid: 103694|app: 0|req: 7/13] 10.222.0.16 () {54 vars in 931 bytes} [Mon Oct 31 19:13:46 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:13:47.189592 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi [None req-3bfa196f-56e6-422e-9d23-9a9042622641 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "ram": 2048, "disk": 10, "id": "d3", "os-flavor-access:is_public": true, "name": "ds2G", "rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:13:47.210511 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: INFO nova.api.openstack.requestlog [None req-3bfa196f-56e6-422e-9d23-9a9042622641 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.425677 Oct 31 19:13:47.218335 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: [pid: 103693|app: 0|req: 7/14] 10.222.0.16 () {64 vars in 1283 bytes} [Mon Oct 31 19:13:46 2022] POST /compute/v2.1/flavors => generated 404 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 31 19:13:47.223361 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi [None req-e255e26d-68b0-4472-8835-4665c1fe95b5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:13:47.253143 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: INFO nova.api.openstack.requestlog [None req-e255e26d-68b0-4472-8835-4665c1fe95b5 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033489 Oct 31 19:13:47.254006 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: [pid: 103694|app: 0|req: 8/15] 10.222.0.16 () {64 vars in 1336 bytes} [Mon Oct 31 19:13:47 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 19:13:49.964659 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi [None req-3bfa196f-56e6-422e-9d23-9a9042622641 admin admin] Calling method '>' {{(pid=103693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:13:49.966014 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: INFO nova.api.openstack.requestlog [None req-3bfa196f-56e6-422e-9d23-9a9042622641 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001946 Oct 31 19:13:49.966504 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: [pid: 103693|app: 0|req: 8/16] 10.222.0.16 () {54 vars in 931 bytes} [Mon Oct 31 19:13:49 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:13:50.411249 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi [None req-bc15fa53-f0df-4a51-8120-c1ec1b42ce83 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "ds4G", "ram": 4096, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "vcpus": 4, "id": "d4"}} {{(pid=103694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:13:50.429439 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: INFO nova.api.openstack.requestlog [None req-bc15fa53-f0df-4a51-8120-c1ec1b42ce83 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.455213 Oct 31 19:13:50.430016 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: [pid: 103694|app: 0|req: 9/17] 10.222.0.16 () {64 vars in 1283 bytes} [Mon Oct 31 19:13:49 2022] POST /compute/v2.1/flavors => generated 404 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 19:13:50.442064 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi [None req-4e28970c-0da6-4268-8805-5e14cc9c5f1e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:13:50.467796 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: INFO nova.api.openstack.requestlog [None req-4e28970c-0da6-4268-8805-5e14cc9c5f1e admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029317 Oct 31 19:13:50.468648 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: [pid: 103693|app: 0|req: 9/18] 10.222.0.16 () {64 vars in 1336 bytes} [Mon Oct 31 19:13:50 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:13:53.626773 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi [None req-bc15fa53-f0df-4a51-8120-c1ec1b42ce83 admin admin] Calling method '>' {{(pid=103694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:13:53.627774 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: INFO nova.api.openstack.requestlog [None req-bc15fa53-f0df-4a51-8120-c1ec1b42ce83 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Oct 31 19:13:53.628171 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: [pid: 103694|app: 0|req: 10/19] 10.222.0.16 () {54 vars in 931 bytes} [Mon Oct 31 19:13:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:13:54.050867 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi [None req-fe477ea6-70ac-427d-a849-2a87612dac85 admin admin] Calling method '>' {{(pid=103693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:13:54.076576 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: INFO nova.api.openstack.requestlog [None req-fe477ea6-70ac-427d-a849-2a87612dac85 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.442291 Oct 31 19:13:54.077155 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: [pid: 103693|app: 0|req: 10/20] 10.222.0.16 () {60 vars in 1292 bytes} [Mon Oct 31 19:13:53 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 19:13:56.703320 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi [None req-bc15fa53-f0df-4a51-8120-c1ec1b42ce83 admin admin] Calling method '>' {{(pid=103694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:13:56.704769 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: INFO nova.api.openstack.requestlog [None req-bc15fa53-f0df-4a51-8120-c1ec1b42ce83 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001977 Oct 31 19:13:56.705170 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: [pid: 103694|app: 0|req: 11/21] 10.222.0.16 () {54 vars in 931 bytes} [Mon Oct 31 19:13:56 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:13:57.101399 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi [None req-2b5b5525-21a1-4a06-bcda-c6e9eaed5c94 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "id": "1", "disk": 1, "os-flavor-access:is_public": true, "ram": 512, "swap": 0, "vcpus": 1, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:13:57.122871 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: INFO nova.api.openstack.requestlog [None req-2b5b5525-21a1-4a06-bcda-c6e9eaed5c94 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.411851 Oct 31 19:13:57.123412 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: [pid: 103693|app: 0|req: 11/22] 10.222.0.16 () {64 vars in 1283 bytes} [Mon Oct 31 19:13:56 2022] POST /compute/v2.1/flavors => generated 402 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 19:13:57.135814 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi [None req-eca684eb-9b98-47e8-ba00-bb8cb11bdc33 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:13:57.162069 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: INFO nova.api.openstack.requestlog [None req-eca684eb-9b98-47e8-ba00-bb8cb11bdc33 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029871 Oct 31 19:13:57.162634 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: [pid: 103694|app: 0|req: 12/23] 10.222.0.16 () {64 vars in 1333 bytes} [Mon Oct 31 19:13:57 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:13:59.753461 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi [None req-2b5b5525-21a1-4a06-bcda-c6e9eaed5c94 admin admin] Calling method '>' {{(pid=103693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:13:59.755174 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: INFO nova.api.openstack.requestlog [None req-2b5b5525-21a1-4a06-bcda-c6e9eaed5c94 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002084 Oct 31 19:13:59.755875 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: [pid: 103693|app: 0|req: 12/24] 10.222.0.16 () {54 vars in 931 bytes} [Mon Oct 31 19:13:59 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:14:00.184426 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi [None req-9b1fa046-6f3c-4d25-9b26-e85a3e59afb0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "m1.small", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 2048, "os-flavor-access:is_public": true, "vcpus": 1, "disk": 20, "id": "2"}} {{(pid=103694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:14:00.204589 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: INFO nova.api.openstack.requestlog [None req-9b1fa046-6f3c-4d25-9b26-e85a3e59afb0 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.442699 Oct 31 19:14:00.205379 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: [pid: 103694|app: 0|req: 13/25] 10.222.0.16 () {64 vars in 1283 bytes} [Mon Oct 31 19:13:59 2022] POST /compute/v2.1/flavors => generated 405 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 19:14:00.217312 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi [None req-ad11d1a3-6232-4fd6-b9d9-d6b2ffe4bfc0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:14:00.241780 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: INFO nova.api.openstack.requestlog [None req-ad11d1a3-6232-4fd6-b9d9-d6b2ffe4bfc0 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027911 Oct 31 19:14:00.242363 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: [pid: 103693|app: 0|req: 13/26] 10.222.0.16 () {64 vars in 1333 bytes} [Mon Oct 31 19:14:00 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:14:02.872158 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi [None req-9b1fa046-6f3c-4d25-9b26-e85a3e59afb0 admin admin] Calling method '>' {{(pid=103694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:14:02.873825 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: INFO nova.api.openstack.requestlog [None req-9b1fa046-6f3c-4d25-9b26-e85a3e59afb0 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002062 Oct 31 19:14:02.874380 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: [pid: 103694|app: 0|req: 14/27] 10.222.0.16 () {54 vars in 931 bytes} [Mon Oct 31 19:14:02 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:14:03.338106 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi [None req-c59ab053-b57b-431d-abba-17eb81670ef1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "rxtx_factor": 1.0, "name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "swap": 0, "os-flavor-access:is_public": true, "id": "3", "disk": 40}} {{(pid=103693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:14:03.359010 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: INFO nova.api.openstack.requestlog [None req-c59ab053-b57b-431d-abba-17eb81670ef1 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.478543 Oct 31 19:14:03.360328 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: [pid: 103693|app: 0|req: 14/28] 10.222.0.16 () {64 vars in 1283 bytes} [Mon Oct 31 19:14:02 2022] POST /compute/v2.1/flavors => generated 406 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 19:14:03.372752 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi [None req-cb68357a-ad82-442f-9567-71196605eff9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:14:03.402489 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: INFO nova.api.openstack.requestlog [None req-cb68357a-ad82-442f-9567-71196605eff9 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033509 Oct 31 19:14:03.416821 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: [pid: 103694|app: 0|req: 15/29] 10.222.0.16 () {64 vars in 1333 bytes} [Mon Oct 31 19:14:03 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:14:06.023002 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi [None req-c59ab053-b57b-431d-abba-17eb81670ef1 admin admin] Calling method '>' {{(pid=103693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:14:06.024009 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: INFO nova.api.openstack.requestlog [None req-c59ab053-b57b-431d-abba-17eb81670ef1 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Oct 31 19:14:06.024586 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: [pid: 103693|app: 0|req: 15/30] 10.222.0.16 () {54 vars in 931 bytes} [Mon Oct 31 19:14:06 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:14:06.472587 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi [None req-5a97900c-1c61-41fd-b7c3-09227e582df1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 8192, "id": "4", "name": "m1.large", "vcpus": 4, "disk": 80}} {{(pid=103694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:14:06.478107 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG dbcounter [-] [103694] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:14:06.497460 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: INFO nova.api.openstack.requestlog [None req-5a97900c-1c61-41fd-b7c3-09227e582df1 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.466848 Oct 31 19:14:06.498106 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: [pid: 103694|app: 0|req: 16/31] 10.222.0.16 () {64 vars in 1283 bytes} [Mon Oct 31 19:14:06 2022] POST /compute/v2.1/flavors => generated 405 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 19:14:06.510202 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi [None req-0db2daa7-511d-4b58-9f5e-575bd99014f2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:14:06.537377 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: INFO nova.api.openstack.requestlog [None req-0db2daa7-511d-4b58-9f5e-575bd99014f2 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030754 Oct 31 19:14:06.538303 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: [pid: 103693|app: 0|req: 16/32] 10.222.0.16 () {64 vars in 1333 bytes} [Mon Oct 31 19:14:06 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 19:14:09.189784 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi [None req-5a97900c-1c61-41fd-b7c3-09227e582df1 admin admin] Calling method '>' {{(pid=103694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:14:09.191365 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: INFO nova.api.openstack.requestlog [None req-5a97900c-1c61-41fd-b7c3-09227e582df1 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002056 Oct 31 19:14:09.192050 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: [pid: 103694|app: 0|req: 17/33] 10.222.0.16 () {54 vars in 931 bytes} [Mon Oct 31 19:14:09 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:14:09.629546 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi [None req-803714e2-9ec7-43dd-8d31-e2e22757a337 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 8, "ram": 16384, "id": "5", "disk": 160, "swap": 0, "name": "m1.xlarge"}} {{(pid=103693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:14:09.639013 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG dbcounter [-] [103693] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=103693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:14:09.652764 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: INFO nova.api.openstack.requestlog [None req-803714e2-9ec7-43dd-8d31-e2e22757a337 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.454745 Oct 31 19:14:09.653313 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: [pid: 103693|app: 0|req: 17/34] 10.222.0.16 () {64 vars in 1283 bytes} [Mon Oct 31 19:14:09 2022] POST /compute/v2.1/flavors => generated 408 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 31 19:14:09.667109 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi [None req-a7415833-eb05-48e6-8305-fcbeb17f72e7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:14:09.692148 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: INFO nova.api.openstack.requestlog [None req-a7415833-eb05-48e6-8305-fcbeb17f72e7 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029655 Oct 31 19:14:09.692733 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: [pid: 103694|app: 0|req: 18/35] 10.222.0.16 () {64 vars in 1333 bytes} [Mon Oct 31 19:14:09 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:14:26.266841 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi [None req-803714e2-9ec7-43dd-8d31-e2e22757a337 admin admin] Calling method '>' {{(pid=103693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:14:26.267857 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: INFO nova.api.openstack.requestlog [None req-803714e2-9ec7-43dd-8d31-e2e22757a337 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Oct 31 19:14:26.268261 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: [pid: 103693|app: 0|req: 18/36] 10.222.0.16 () {54 vars in 931 bytes} [Mon Oct 31 19:14:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:14:26.278909 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG dbcounter [-] [103694] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=103694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:14:26.657631 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi [None req-3e7b6350-e92d-4bce-8016-e778d6f050b5 admin admin] Calling method '>' {{(pid=103694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:14:26.676060 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: INFO nova.api.openstack.requestlog [None req-3e7b6350-e92d-4bce-8016-e778d6f050b5 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.401598 Oct 31 19:14:26.676598 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: [pid: 103694|app: 0|req: 19/37] 10.222.0.16 () {60 vars in 1292 bytes} [Mon Oct 31 19:14:26 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 19:14:27.962616 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi [None req-803714e2-9ec7-43dd-8d31-e2e22757a337 admin admin] Calling method '>' {{(pid=103693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:14:27.963644 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: INFO nova.api.openstack.requestlog [None req-803714e2-9ec7-43dd-8d31-e2e22757a337 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001428 Oct 31 19:14:27.964043 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: [pid: 103693|app: 0|req: 19/38] 10.222.0.16 () {56 vars in 1074 bytes} [Mon Oct 31 19:14:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:14:28.493666 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi [None req-c3b34ac6-0017-4b1e-ab73-3ee2ae7f0eb6 admin admin] Calling method '>' {{(pid=103694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:14:28.499073 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: INFO nova.api.openstack.wsgi [None req-c3b34ac6-0017-4b1e-ab73-3ee2ae7f0eb6 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 31 19:14:28.502257 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi [None req-c3b34ac6-0017-4b1e-ab73-3ee2ae7f0eb6 admin admin] Request method failure captured: Oct 31 19:14:28.502257 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 31 19:14:28.502257 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: Accept: application/json Oct 31 19:14:28.502257 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: Accept-Encoding: gzip, deflate Oct 31 19:14:28.502257 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: Connection: keep-alive Oct 31 19:14:28.502257 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: Content-Length: 0 Oct 31 19:14:28.502257 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: Host: 10.222.0.16 Oct 31 19:14:28.502257 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: Openstack-Api-Version: compute 2.92 Oct 31 19:14:28.502257 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: Openstack-System-Scope: None Oct 31 19:14:28.502257 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: User-Agent: python-novaclient Oct 31 19:14:28.502257 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: X-Auth-Token: gAAAAABjYB6TzAQuXzJBn7BobCrfXheceETe5OsAwZIf08hDUQi4QM3xTsax7MSKnpYxFNVHgrKDNubh5aKL2Xk54wQx_wOa61lnVFRdvzWQbqLP0lMwjFlyUjSLV-yHr1hdlwQKNzu0bF-0l4ltgaAEvtkKb3w2hhfvpNOyWuM4VO8GXdVaLiM Oct 31 19:14:28.502257 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: X-Domain-Id: None Oct 31 19:14:28.502257 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: X-Domain-Name: None Oct 31 19:14:28.502257 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: X-Identity-Status: Confirmed Oct 31 19:14:28.502257 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: X-Is-Admin-Project: True Oct 31 19:14:28.502257 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: X-Openstack-Nova-Api-Version: 2.92 Oct 31 19:14:28.502257 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: X-Project-Domain-Id: default Oct 31 19:14:28.502257 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: X-Project-Domain-Name: Default Oct 31 19:14:28.502257 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: X-Project-Id: 591ddd6b76544d72ba30ff2a54cd0082 Oct 31 19:14:28.502257 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: X-Project-Name: admin Oct 31 19:14:28.502257 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: X-Role: member,admin,reader Oct 31 19:14:28.502257 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: X-Roles: member,admin,reader Oct 31 19:14:28.503853 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/591ddd6b76544d72ba30ff2a54cd0082"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_591ddd6b76544d72ba30ff2a54cd0082", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/591ddd6b76544d72ba30ff2a54cd0082"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/591ddd6b76544d72ba30ff2a54cd0082"}]}] Oct 31 19:14:28.503853 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: X-Tenant: admin Oct 31 19:14:28.503853 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: X-Tenant-Id: 591ddd6b76544d72ba30ff2a54cd0082 Oct 31 19:14:28.503853 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: X-Tenant-Name: admin Oct 31 19:14:28.503853 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: X-User: admin Oct 31 19:14:28.503853 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: X-User-Domain-Id: default Oct 31 19:14:28.503853 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: X-User-Domain-Name: Default Oct 31 19:14:28.503853 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: X-User-Id: 79b29ba1ff6245d5bfe898f8250028cc Oct 31 19:14:28.503853 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: X-User-Name: admin Oct 31 19:14:28.503853 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: method: > Oct 31 19:14:28.503853 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: exception: Flavor 42 could not be found. Oct 31 19:14:28.503853 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: action_args: {'id': '42'} Oct 31 19:14:28.503853 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: {{(pid=103694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 19:14:28.503853 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:14:28.504728 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 31 19:14:28.504728 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 31 19:14:28.504728 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 31 19:14:28.504728 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 31 19:14:28.504728 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 31 19:14:28.504728 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 31 19:14:28.504728 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 31 19:14:28.504728 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 31 19:14:28.504728 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 31 19:14:28.504728 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 19:14:28.504728 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 31 19:14:28.504728 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 31 19:14:28.504728 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 31 19:14:28.504728 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: ERROR nova.api.openstack.wsgi Oct 31 19:14:28.504728 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 19:14:28.504728 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: ERROR nova.api.openstack.wsgi Oct 31 19:14:28.504728 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:14:28.504728 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 19:14:28.504728 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 19:14:28.506222 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 19:14:28.506222 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 19:14:28.506222 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 19:14:28.506222 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 19:14:28.506222 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 31 19:14:28.506222 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 31 19:14:28.506222 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 31 19:14:28.506222 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: ERROR nova.api.openstack.wsgi Oct 31 19:14:28.506222 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 19:14:28.506222 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: ERROR nova.api.openstack.wsgi Oct 31 19:14:28.506222 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:14:28.506222 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 19:14:28.506222 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 19:14:28.506222 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 19:14:28.506222 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 19:14:28.506222 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 31 19:14:28.506222 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: ERROR nova.api.openstack.wsgi Oct 31 19:14:28.506222 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi [None req-c3b34ac6-0017-4b1e-ab73-3ee2ae7f0eb6 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103694) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 19:14:28.507489 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: INFO nova.api.openstack.requestlog [None req-c3b34ac6-0017-4b1e-ab73-3ee2ae7f0eb6 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.388617 Oct 31 19:14:28.507489 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: [pid: 103694|app: 0|req: 20/39] 10.222.0.16 () {60 vars in 1190 bytes} [Mon Oct 31 19:14:28 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 390 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 31 19:14:28.513158 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi [None req-e574ca8d-6452-43e5-9adf-bd12f7bf7de5 admin admin] Calling method '>' {{(pid=103693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:14:28.536818 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: INFO nova.api.openstack.requestlog [None req-e574ca8d-6452-43e5-9adf-bd12f7bf7de5 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027194 Oct 31 19:14:28.537358 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: [pid: 103693|app: 0|req: 20/40] 10.222.0.16 () {60 vars in 1210 bytes} [Mon Oct 31 19:14:28 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 19:14:28.548397 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi [None req-e75f88a3-e856-4472-b2f9-debe308d3936 admin admin] Calling method '>' {{(pid=103694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:14:28.569927 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: INFO nova.api.openstack.requestlog [None req-e75f88a3-e856-4472-b2f9-debe308d3936 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026572 Oct 31 19:14:28.570451 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: [pid: 103694|app: 0|req: 21/41] 10.222.0.16 () {60 vars in 1210 bytes} [Mon Oct 31 19:14:28 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 19:14:28.580641 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi [None req-0217cd3f-af38-4a15-be0e-efd2073a7ca1 admin admin] Calling method '>' {{(pid=103693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:14:28.585925 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: INFO nova.api.openstack.wsgi [None req-0217cd3f-af38-4a15-be0e-efd2073a7ca1 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 31 19:14:28.589123 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi [None req-0217cd3f-af38-4a15-be0e-efd2073a7ca1 admin admin] Request method failure captured: Oct 31 19:14:28.589123 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 31 19:14:28.589123 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: Accept: application/json Oct 31 19:14:28.589123 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: Accept-Encoding: gzip, deflate Oct 31 19:14:28.589123 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: Connection: keep-alive Oct 31 19:14:28.589123 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: Content-Length: 0 Oct 31 19:14:28.589123 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: Host: 10.222.0.16 Oct 31 19:14:28.589123 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: Openstack-Api-Version: compute 2.92 Oct 31 19:14:28.589123 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: Openstack-System-Scope: None Oct 31 19:14:28.589123 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: User-Agent: python-novaclient Oct 31 19:14:28.589123 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: X-Auth-Token: gAAAAABjYB6TzAQuXzJBn7BobCrfXheceETe5OsAwZIf08hDUQi4QM3xTsax7MSKnpYxFNVHgrKDNubh5aKL2Xk54wQx_wOa61lnVFRdvzWQbqLP0lMwjFlyUjSLV-yHr1hdlwQKNzu0bF-0l4ltgaAEvtkKb3w2hhfvpNOyWuM4VO8GXdVaLiM Oct 31 19:14:28.589123 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: X-Domain-Id: None Oct 31 19:14:28.589123 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: X-Domain-Name: None Oct 31 19:14:28.589123 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: X-Identity-Status: Confirmed Oct 31 19:14:28.589123 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: X-Is-Admin-Project: True Oct 31 19:14:28.589123 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: X-Openstack-Nova-Api-Version: 2.92 Oct 31 19:14:28.589123 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: X-Project-Domain-Id: default Oct 31 19:14:28.589123 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: X-Project-Domain-Name: Default Oct 31 19:14:28.589123 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: X-Project-Id: 591ddd6b76544d72ba30ff2a54cd0082 Oct 31 19:14:28.589123 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: X-Project-Name: admin Oct 31 19:14:28.589123 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: X-Role: member,admin,reader Oct 31 19:14:28.589123 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: X-Roles: member,admin,reader Oct 31 19:14:28.590711 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/591ddd6b76544d72ba30ff2a54cd0082"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_591ddd6b76544d72ba30ff2a54cd0082", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/591ddd6b76544d72ba30ff2a54cd0082"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/591ddd6b76544d72ba30ff2a54cd0082"}]}] Oct 31 19:14:28.590711 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: X-Tenant: admin Oct 31 19:14:28.590711 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: X-Tenant-Id: 591ddd6b76544d72ba30ff2a54cd0082 Oct 31 19:14:28.590711 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: X-Tenant-Name: admin Oct 31 19:14:28.590711 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: X-User: admin Oct 31 19:14:28.590711 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: X-User-Domain-Id: default Oct 31 19:14:28.590711 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: X-User-Domain-Name: Default Oct 31 19:14:28.590711 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: X-User-Id: 79b29ba1ff6245d5bfe898f8250028cc Oct 31 19:14:28.590711 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: X-User-Name: admin Oct 31 19:14:28.590711 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: method: > Oct 31 19:14:28.590711 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: exception: Flavor 42 could not be found. Oct 31 19:14:28.590711 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: action_args: {'id': '42'} Oct 31 19:14:28.590711 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: {{(pid=103693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 19:14:28.590711 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:14:28.591725 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 31 19:14:28.591725 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 31 19:14:28.591725 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 31 19:14:28.591725 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 31 19:14:28.591725 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 31 19:14:28.591725 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 31 19:14:28.591725 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 31 19:14:28.591725 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 31 19:14:28.591725 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 31 19:14:28.591725 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 19:14:28.591725 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 31 19:14:28.591725 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 31 19:14:28.591725 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 31 19:14:28.591725 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi Oct 31 19:14:28.591725 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 19:14:28.591725 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi Oct 31 19:14:28.591725 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:14:28.591725 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 19:14:28.591725 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 19:14:28.592757 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 19:14:28.592757 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 19:14:28.592757 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 19:14:28.592757 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 19:14:28.592757 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 31 19:14:28.592757 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 31 19:14:28.592757 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 31 19:14:28.592757 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi Oct 31 19:14:28.592757 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 19:14:28.592757 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi Oct 31 19:14:28.592757 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:14:28.592757 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 19:14:28.592757 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 19:14:28.592757 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 19:14:28.592757 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 19:14:28.592757 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 31 19:14:28.592757 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi Oct 31 19:14:28.592757 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi [None req-0217cd3f-af38-4a15-be0e-efd2073a7ca1 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103693) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 19:14:28.594498 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: INFO nova.api.openstack.requestlog [None req-0217cd3f-af38-4a15-be0e-efd2073a7ca1 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014426 Oct 31 19:14:28.594498 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: [pid: 103693|app: 0|req: 21/42] 10.222.0.16 () {60 vars in 1190 bytes} [Mon Oct 31 19:14:28 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 31 19:14:29.784826 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi [None req-e75f88a3-e856-4472-b2f9-debe308d3936 admin admin] Calling method '>' {{(pid=103694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:14:29.785866 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: INFO nova.api.openstack.requestlog [None req-e75f88a3-e856-4472-b2f9-debe308d3936 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001682 Oct 31 19:14:29.786268 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: [pid: 103694|app: 0|req: 22/43] 10.222.0.16 () {56 vars in 1074 bytes} [Mon Oct 31 19:14:29 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:14:30.304018 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi [None req-565c4cce-5f0b-49d8-86ff-ac6bf40ea03a admin admin] Calling method '>' {{(pid=103693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:14:30.309034 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: INFO nova.api.openstack.wsgi [None req-565c4cce-5f0b-49d8-86ff-ac6bf40ea03a admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 31 19:14:30.310570 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi [None req-565c4cce-5f0b-49d8-86ff-ac6bf40ea03a admin admin] Request method failure captured: Oct 31 19:14:30.310570 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 31 19:14:30.310570 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: Accept: application/json Oct 31 19:14:30.310570 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: Accept-Encoding: gzip, deflate Oct 31 19:14:30.310570 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: Connection: keep-alive Oct 31 19:14:30.310570 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: Content-Length: 0 Oct 31 19:14:30.310570 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: Host: 10.222.0.16 Oct 31 19:14:30.310570 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: Openstack-Api-Version: compute 2.92 Oct 31 19:14:30.310570 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: Openstack-System-Scope: None Oct 31 19:14:30.310570 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: User-Agent: python-novaclient Oct 31 19:14:30.310570 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: X-Auth-Token: gAAAAABjYB6VEn8CBkuCjXUbBKZDTWmcHsInlC9zTCVaSrNA-k5KThafrlu1PK0n6jx_Fj4eRQjjNDrgDXn4lkSfaHPMy6x_l01911CoebPVfh5bjYdqCr7kC4bdJojcUTqVsWQEffu3TfmthGr-8vo1fl_chEa7ivyI-26F4PDmB6IiGIxMFv0 Oct 31 19:14:30.310570 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: X-Domain-Id: None Oct 31 19:14:30.310570 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: X-Domain-Name: None Oct 31 19:14:30.310570 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: X-Identity-Status: Confirmed Oct 31 19:14:30.310570 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: X-Is-Admin-Project: True Oct 31 19:14:30.310570 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: X-Openstack-Nova-Api-Version: 2.92 Oct 31 19:14:30.310570 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: X-Project-Domain-Id: default Oct 31 19:14:30.310570 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: X-Project-Domain-Name: Default Oct 31 19:14:30.310570 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: X-Project-Id: 591ddd6b76544d72ba30ff2a54cd0082 Oct 31 19:14:30.310570 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: X-Project-Name: admin Oct 31 19:14:30.310570 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: X-Role: member,admin,reader Oct 31 19:14:30.310570 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: X-Roles: member,admin,reader Oct 31 19:14:30.312574 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/591ddd6b76544d72ba30ff2a54cd0082"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_591ddd6b76544d72ba30ff2a54cd0082", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/591ddd6b76544d72ba30ff2a54cd0082"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/591ddd6b76544d72ba30ff2a54cd0082"}]}] Oct 31 19:14:30.312574 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: X-Tenant: admin Oct 31 19:14:30.312574 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: X-Tenant-Id: 591ddd6b76544d72ba30ff2a54cd0082 Oct 31 19:14:30.312574 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: X-Tenant-Name: admin Oct 31 19:14:30.312574 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: X-User: admin Oct 31 19:14:30.312574 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: X-User-Domain-Id: default Oct 31 19:14:30.312574 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: X-User-Domain-Name: Default Oct 31 19:14:30.312574 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: X-User-Id: 79b29ba1ff6245d5bfe898f8250028cc Oct 31 19:14:30.312574 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: X-User-Name: admin Oct 31 19:14:30.312574 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: method: > Oct 31 19:14:30.312574 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: exception: Flavor 84 could not be found. Oct 31 19:14:30.312574 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: action_args: {'id': '84'} Oct 31 19:14:30.312574 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: {{(pid=103693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 19:14:30.312574 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:14:30.313490 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 31 19:14:30.313490 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 31 19:14:30.313490 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 31 19:14:30.313490 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 31 19:14:30.313490 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 31 19:14:30.313490 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 31 19:14:30.313490 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 31 19:14:30.313490 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 31 19:14:30.313490 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 31 19:14:30.313490 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 19:14:30.313490 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 31 19:14:30.313490 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 31 19:14:30.313490 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 31 19:14:30.313490 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi Oct 31 19:14:30.313490 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 19:14:30.313490 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi Oct 31 19:14:30.313490 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:14:30.313490 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 19:14:30.313490 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 19:14:30.314911 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 19:14:30.314911 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 19:14:30.314911 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 19:14:30.314911 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 19:14:30.314911 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 31 19:14:30.314911 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 31 19:14:30.314911 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 31 19:14:30.314911 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi Oct 31 19:14:30.314911 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 19:14:30.314911 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi Oct 31 19:14:30.314911 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:14:30.314911 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 19:14:30.314911 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 19:14:30.314911 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 19:14:30.314911 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 19:14:30.314911 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 31 19:14:30.314911 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi Oct 31 19:14:30.314911 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi [None req-565c4cce-5f0b-49d8-86ff-ac6bf40ea03a admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103693) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 19:14:30.316135 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: INFO nova.api.openstack.requestlog [None req-565c4cce-5f0b-49d8-86ff-ac6bf40ea03a admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.390419 Oct 31 19:14:30.316135 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: [pid: 103693|app: 0|req: 22/44] 10.222.0.16 () {60 vars in 1190 bytes} [Mon Oct 31 19:14:29 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 392 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 31 19:14:30.322085 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi [None req-cdb41c8b-7b0a-42de-9f5a-3baa11d38177 admin admin] Calling method '>' {{(pid=103694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:14:30.336684 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: INFO nova.api.openstack.requestlog [None req-cdb41c8b-7b0a-42de-9f5a-3baa11d38177 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018183 Oct 31 19:14:30.337203 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: [pid: 103694|app: 0|req: 23/45] 10.222.0.16 () {60 vars in 1210 bytes} [Mon Oct 31 19:14:30 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 19:14:30.346452 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi [None req-c7392453-84fb-43b6-8dd2-e87221e32bd3 admin admin] Calling method '>' {{(pid=103693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:14:30.361947 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: INFO nova.api.openstack.requestlog [None req-c7392453-84fb-43b6-8dd2-e87221e32bd3 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019049 Oct 31 19:14:30.362465 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: [pid: 103693|app: 0|req: 23/46] 10.222.0.16 () {60 vars in 1210 bytes} [Mon Oct 31 19:14:30 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 19:14:30.371473 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi [None req-2fdc0679-bd01-4c51-a568-ed90fe75ad6e admin admin] Calling method '>' {{(pid=103694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:14:30.376458 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: INFO nova.api.openstack.wsgi [None req-2fdc0679-bd01-4c51-a568-ed90fe75ad6e admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 31 19:14:30.377991 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi [None req-2fdc0679-bd01-4c51-a568-ed90fe75ad6e admin admin] Request method failure captured: Oct 31 19:14:30.377991 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 31 19:14:30.377991 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: Accept: application/json Oct 31 19:14:30.377991 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: Accept-Encoding: gzip, deflate Oct 31 19:14:30.377991 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: Connection: keep-alive Oct 31 19:14:30.377991 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: Content-Length: 0 Oct 31 19:14:30.377991 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: Host: 10.222.0.16 Oct 31 19:14:30.377991 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: Openstack-Api-Version: compute 2.92 Oct 31 19:14:30.377991 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: Openstack-System-Scope: None Oct 31 19:14:30.377991 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: User-Agent: python-novaclient Oct 31 19:14:30.377991 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: X-Auth-Token: gAAAAABjYB6VEn8CBkuCjXUbBKZDTWmcHsInlC9zTCVaSrNA-k5KThafrlu1PK0n6jx_Fj4eRQjjNDrgDXn4lkSfaHPMy6x_l01911CoebPVfh5bjYdqCr7kC4bdJojcUTqVsWQEffu3TfmthGr-8vo1fl_chEa7ivyI-26F4PDmB6IiGIxMFv0 Oct 31 19:14:30.377991 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: X-Domain-Id: None Oct 31 19:14:30.377991 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: X-Domain-Name: None Oct 31 19:14:30.377991 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: X-Identity-Status: Confirmed Oct 31 19:14:30.377991 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: X-Is-Admin-Project: True Oct 31 19:14:30.377991 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: X-Openstack-Nova-Api-Version: 2.92 Oct 31 19:14:30.377991 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: X-Project-Domain-Id: default Oct 31 19:14:30.377991 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: X-Project-Domain-Name: Default Oct 31 19:14:30.377991 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: X-Project-Id: 591ddd6b76544d72ba30ff2a54cd0082 Oct 31 19:14:30.377991 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: X-Project-Name: admin Oct 31 19:14:30.377991 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: X-Role: member,admin,reader Oct 31 19:14:30.377991 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: X-Roles: member,admin,reader Oct 31 19:14:30.379513 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/591ddd6b76544d72ba30ff2a54cd0082"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_591ddd6b76544d72ba30ff2a54cd0082", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/591ddd6b76544d72ba30ff2a54cd0082"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/591ddd6b76544d72ba30ff2a54cd0082"}]}] Oct 31 19:14:30.379513 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: X-Tenant: admin Oct 31 19:14:30.379513 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: X-Tenant-Id: 591ddd6b76544d72ba30ff2a54cd0082 Oct 31 19:14:30.379513 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: X-Tenant-Name: admin Oct 31 19:14:30.379513 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: X-User: admin Oct 31 19:14:30.379513 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: X-User-Domain-Id: default Oct 31 19:14:30.379513 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: X-User-Domain-Name: Default Oct 31 19:14:30.379513 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: X-User-Id: 79b29ba1ff6245d5bfe898f8250028cc Oct 31 19:14:30.379513 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: X-User-Name: admin Oct 31 19:14:30.379513 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: method: > Oct 31 19:14:30.379513 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: exception: Flavor 84 could not be found. Oct 31 19:14:30.379513 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: action_args: {'id': '84'} Oct 31 19:14:30.379513 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: {{(pid=103694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 19:14:30.379513 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:14:30.380485 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 31 19:14:30.380485 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 31 19:14:30.380485 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 31 19:14:30.380485 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 31 19:14:30.380485 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 31 19:14:30.380485 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 31 19:14:30.380485 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 31 19:14:30.380485 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 31 19:14:30.380485 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 31 19:14:30.380485 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 19:14:30.380485 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 31 19:14:30.380485 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 31 19:14:30.380485 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 31 19:14:30.380485 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: ERROR nova.api.openstack.wsgi Oct 31 19:14:30.380485 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 19:14:30.380485 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: ERROR nova.api.openstack.wsgi Oct 31 19:14:30.380485 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:14:30.380485 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 19:14:30.380485 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 19:14:30.381835 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 19:14:30.381835 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 19:14:30.381835 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 19:14:30.381835 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 19:14:30.381835 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 31 19:14:30.381835 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 31 19:14:30.381835 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 31 19:14:30.381835 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: ERROR nova.api.openstack.wsgi Oct 31 19:14:30.381835 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 19:14:30.381835 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: ERROR nova.api.openstack.wsgi Oct 31 19:14:30.381835 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:14:30.381835 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 19:14:30.381835 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 19:14:30.381835 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 19:14:30.381835 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 19:14:30.381835 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 31 19:14:30.381835 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: ERROR nova.api.openstack.wsgi Oct 31 19:14:30.381835 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi [None req-2fdc0679-bd01-4c51-a568-ed90fe75ad6e admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103694) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 19:14:30.383064 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: INFO nova.api.openstack.requestlog [None req-2fdc0679-bd01-4c51-a568-ed90fe75ad6e admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011297 Oct 31 19:14:30.383064 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: [pid: 103694|app: 0|req: 24/47] 10.222.0.16 () {60 vars in 1190 bytes} [Mon Oct 31 19:14:30 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 31 19:14:31.574940 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi [None req-c7392453-84fb-43b6-8dd2-e87221e32bd3 admin admin] Calling method '>' {{(pid=103693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:14:31.575945 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: INFO nova.api.openstack.requestlog [None req-c7392453-84fb-43b6-8dd2-e87221e32bd3 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Oct 31 19:14:31.576342 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: [pid: 103693|app: 0|req: 24/48] 10.222.0.16 () {56 vars in 1074 bytes} [Mon Oct 31 19:14:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:14:32.097419 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi [None req-cd42080d-d694-44e5-b5ae-f6e1f3f37a86 admin admin] Calling method '>' {{(pid=103694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:14:32.103185 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: INFO nova.api.openstack.wsgi [None req-cd42080d-d694-44e5-b5ae-f6e1f3f37a86 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 31 19:14:32.104661 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi [None req-cd42080d-d694-44e5-b5ae-f6e1f3f37a86 admin admin] Request method failure captured: Oct 31 19:14:32.104661 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 31 19:14:32.104661 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: Accept: application/json Oct 31 19:14:32.104661 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: Accept-Encoding: gzip, deflate Oct 31 19:14:32.104661 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: Connection: keep-alive Oct 31 19:14:32.104661 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: Content-Length: 0 Oct 31 19:14:32.104661 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: Host: 10.222.0.16 Oct 31 19:14:32.104661 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: Openstack-Api-Version: compute 2.92 Oct 31 19:14:32.104661 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: Openstack-System-Scope: None Oct 31 19:14:32.104661 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: User-Agent: python-novaclient Oct 31 19:14:32.104661 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: X-Auth-Token: gAAAAABjYB6XqpGSZlp6X8UyFvijt9Irp7_vLQXM2PWYSsVo7Cb_oUqtbpNlIdeHvjukglqne_LsBeLNEyRqljRDAb6SJg1cWvOxiYw_f6EdcBaHzMD-B1vYrnTTLtcVMlCzHhk6tdGl1at5u9ejLZ2bRhoVYqqF3B3g_Mm9JKEiagUtMyoP6aw Oct 31 19:14:32.104661 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: X-Domain-Id: None Oct 31 19:14:32.104661 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: X-Domain-Name: None Oct 31 19:14:32.104661 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: X-Identity-Status: Confirmed Oct 31 19:14:32.104661 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: X-Is-Admin-Project: True Oct 31 19:14:32.104661 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: X-Openstack-Nova-Api-Version: 2.92 Oct 31 19:14:32.104661 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: X-Project-Domain-Id: default Oct 31 19:14:32.104661 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: X-Project-Domain-Name: Default Oct 31 19:14:32.104661 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: X-Project-Id: 591ddd6b76544d72ba30ff2a54cd0082 Oct 31 19:14:32.104661 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: X-Project-Name: admin Oct 31 19:14:32.104661 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: X-Role: member,admin,reader Oct 31 19:14:32.104661 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: X-Roles: member,admin,reader Oct 31 19:14:32.106170 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/591ddd6b76544d72ba30ff2a54cd0082"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_591ddd6b76544d72ba30ff2a54cd0082", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/591ddd6b76544d72ba30ff2a54cd0082"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/591ddd6b76544d72ba30ff2a54cd0082"}]}] Oct 31 19:14:32.106170 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: X-Tenant: admin Oct 31 19:14:32.106170 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: X-Tenant-Id: 591ddd6b76544d72ba30ff2a54cd0082 Oct 31 19:14:32.106170 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: X-Tenant-Name: admin Oct 31 19:14:32.106170 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: X-User: admin Oct 31 19:14:32.106170 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: X-User-Domain-Id: default Oct 31 19:14:32.106170 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: X-User-Domain-Name: Default Oct 31 19:14:32.106170 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: X-User-Id: 79b29ba1ff6245d5bfe898f8250028cc Oct 31 19:14:32.106170 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: X-User-Name: admin Oct 31 19:14:32.106170 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: method: > Oct 31 19:14:32.106170 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: exception: Flavor 451 could not be found. Oct 31 19:14:32.106170 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: action_args: {'id': '451'} Oct 31 19:14:32.106170 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: {{(pid=103694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 19:14:32.106170 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:14:32.107044 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 31 19:14:32.107044 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 31 19:14:32.107044 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 31 19:14:32.107044 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 31 19:14:32.107044 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 31 19:14:32.107044 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 31 19:14:32.107044 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 31 19:14:32.107044 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 31 19:14:32.107044 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 31 19:14:32.107044 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 19:14:32.107044 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 31 19:14:32.107044 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 31 19:14:32.107044 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 31 19:14:32.107044 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: ERROR nova.api.openstack.wsgi Oct 31 19:14:32.107044 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 19:14:32.107044 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: ERROR nova.api.openstack.wsgi Oct 31 19:14:32.107044 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:14:32.107044 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 19:14:32.107044 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 19:14:32.108100 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 19:14:32.108100 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 19:14:32.108100 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 19:14:32.108100 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 19:14:32.108100 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 31 19:14:32.108100 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 31 19:14:32.108100 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 31 19:14:32.108100 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: ERROR nova.api.openstack.wsgi Oct 31 19:14:32.108100 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 19:14:32.108100 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: ERROR nova.api.openstack.wsgi Oct 31 19:14:32.108100 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:14:32.108100 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 19:14:32.108100 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 19:14:32.108100 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 19:14:32.108100 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 19:14:32.108100 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 31 19:14:32.108100 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: ERROR nova.api.openstack.wsgi Oct 31 19:14:32.108100 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi [None req-cd42080d-d694-44e5-b5ae-f6e1f3f37a86 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103694) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 19:14:32.109177 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: INFO nova.api.openstack.requestlog [None req-cd42080d-d694-44e5-b5ae-f6e1f3f37a86 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.390303 Oct 31 19:14:32.109177 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: [pid: 103694|app: 0|req: 25/49] 10.222.0.16 () {60 vars in 1193 bytes} [Mon Oct 31 19:14:31 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 391 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 31 19:14:32.115532 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi [None req-50579a35-a995-4c0d-b7fc-222f162fab49 admin admin] Calling method '>' {{(pid=103693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:14:32.130713 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: INFO nova.api.openstack.requestlog [None req-50579a35-a995-4c0d-b7fc-222f162fab49 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018693 Oct 31 19:14:32.131235 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: [pid: 103693|app: 0|req: 25/50] 10.222.0.16 () {60 vars in 1210 bytes} [Mon Oct 31 19:14:32 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 19:14:32.140892 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi [None req-7aed4c26-3601-4a97-9936-9431d71035b5 admin admin] Calling method '>' {{(pid=103694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:14:32.155579 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: INFO nova.api.openstack.requestlog [None req-7aed4c26-3601-4a97-9936-9431d71035b5 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018791 Oct 31 19:14:32.156110 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: [pid: 103694|app: 0|req: 26/51] 10.222.0.16 () {60 vars in 1210 bytes} [Mon Oct 31 19:14:32 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 19:14:32.165285 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi [None req-037056db-184c-4c89-b726-94c4292e5acf admin admin] Calling method '>' {{(pid=103693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:14:32.170089 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: INFO nova.api.openstack.wsgi [None req-037056db-184c-4c89-b726-94c4292e5acf admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 31 19:14:32.171558 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi [None req-037056db-184c-4c89-b726-94c4292e5acf admin admin] Request method failure captured: Oct 31 19:14:32.171558 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 31 19:14:32.171558 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: Accept: application/json Oct 31 19:14:32.171558 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: Accept-Encoding: gzip, deflate Oct 31 19:14:32.171558 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: Connection: keep-alive Oct 31 19:14:32.171558 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: Content-Length: 0 Oct 31 19:14:32.171558 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: Host: 10.222.0.16 Oct 31 19:14:32.171558 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: Openstack-Api-Version: compute 2.92 Oct 31 19:14:32.171558 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: Openstack-System-Scope: None Oct 31 19:14:32.171558 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: User-Agent: python-novaclient Oct 31 19:14:32.171558 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: X-Auth-Token: gAAAAABjYB6XqpGSZlp6X8UyFvijt9Irp7_vLQXM2PWYSsVo7Cb_oUqtbpNlIdeHvjukglqne_LsBeLNEyRqljRDAb6SJg1cWvOxiYw_f6EdcBaHzMD-B1vYrnTTLtcVMlCzHhk6tdGl1at5u9ejLZ2bRhoVYqqF3B3g_Mm9JKEiagUtMyoP6aw Oct 31 19:14:32.171558 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: X-Domain-Id: None Oct 31 19:14:32.171558 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: X-Domain-Name: None Oct 31 19:14:32.171558 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: X-Identity-Status: Confirmed Oct 31 19:14:32.171558 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: X-Is-Admin-Project: True Oct 31 19:14:32.171558 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: X-Openstack-Nova-Api-Version: 2.92 Oct 31 19:14:32.171558 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: X-Project-Domain-Id: default Oct 31 19:14:32.171558 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: X-Project-Domain-Name: Default Oct 31 19:14:32.171558 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: X-Project-Id: 591ddd6b76544d72ba30ff2a54cd0082 Oct 31 19:14:32.171558 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: X-Project-Name: admin Oct 31 19:14:32.171558 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: X-Role: member,admin,reader Oct 31 19:14:32.171558 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: X-Roles: member,admin,reader Oct 31 19:14:32.173150 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/591ddd6b76544d72ba30ff2a54cd0082"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_591ddd6b76544d72ba30ff2a54cd0082", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/591ddd6b76544d72ba30ff2a54cd0082"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/591ddd6b76544d72ba30ff2a54cd0082"}]}] Oct 31 19:14:32.173150 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: X-Tenant: admin Oct 31 19:14:32.173150 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: X-Tenant-Id: 591ddd6b76544d72ba30ff2a54cd0082 Oct 31 19:14:32.173150 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: X-Tenant-Name: admin Oct 31 19:14:32.173150 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: X-User: admin Oct 31 19:14:32.173150 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: X-User-Domain-Id: default Oct 31 19:14:32.173150 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: X-User-Domain-Name: Default Oct 31 19:14:32.173150 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: X-User-Id: 79b29ba1ff6245d5bfe898f8250028cc Oct 31 19:14:32.173150 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: X-User-Name: admin Oct 31 19:14:32.173150 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: method: > Oct 31 19:14:32.173150 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: exception: Flavor 451 could not be found. Oct 31 19:14:32.173150 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: action_args: {'id': '451'} Oct 31 19:14:32.173150 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: {{(pid=103693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 19:14:32.173150 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:14:32.174144 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 31 19:14:32.174144 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 31 19:14:32.174144 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 31 19:14:32.174144 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 31 19:14:32.174144 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 31 19:14:32.174144 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 31 19:14:32.174144 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 31 19:14:32.174144 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 31 19:14:32.174144 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 31 19:14:32.174144 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 19:14:32.174144 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 31 19:14:32.174144 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 31 19:14:32.174144 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 31 19:14:32.174144 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi Oct 31 19:14:32.174144 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 19:14:32.174144 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi Oct 31 19:14:32.174144 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:14:32.174144 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 19:14:32.174144 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 19:14:32.175523 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 19:14:32.175523 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 19:14:32.175523 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 19:14:32.175523 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 19:14:32.175523 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 31 19:14:32.175523 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 31 19:14:32.175523 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 31 19:14:32.175523 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi Oct 31 19:14:32.175523 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 19:14:32.175523 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi Oct 31 19:14:32.175523 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:14:32.175523 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 19:14:32.175523 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 19:14:32.175523 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 19:14:32.175523 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 19:14:32.175523 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 31 19:14:32.175523 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi Oct 31 19:14:32.175523 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi [None req-037056db-184c-4c89-b726-94c4292e5acf admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103693) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 19:14:32.176767 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: INFO nova.api.openstack.requestlog [None req-037056db-184c-4c89-b726-94c4292e5acf admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011012 Oct 31 19:14:32.176767 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: [pid: 103693|app: 0|req: 26/52] 10.222.0.16 () {60 vars in 1193 bytes} [Mon Oct 31 19:14:32 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 31 19:14:33.385463 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi [None req-7aed4c26-3601-4a97-9936-9431d71035b5 admin admin] Calling method '>' {{(pid=103694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:14:33.386489 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: INFO nova.api.openstack.requestlog [None req-7aed4c26-3601-4a97-9936-9431d71035b5 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Oct 31 19:14:33.386881 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: [pid: 103694|app: 0|req: 27/53] 10.222.0.16 () {56 vars in 1074 bytes} [Mon Oct 31 19:14:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:14:33.908029 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi [None req-d44c6146-c4d6-4e9b-9624-e4b536020282 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:14:33.927689 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: INFO nova.api.openstack.requestlog [None req-d44c6146-c4d6-4e9b-9624-e4b536020282 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.403322 Oct 31 19:14:33.928228 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: [pid: 103693|app: 0|req: 27/54] 10.222.0.16 () {64 vars in 1235 bytes} [Mon Oct 31 19:14:33 2022] POST /compute/v2.1/flavors => generated 404 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 19:14:35.139317 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi [None req-7aed4c26-3601-4a97-9936-9431d71035b5 admin admin] Calling method '>' {{(pid=103694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:14:35.140315 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: INFO nova.api.openstack.requestlog [None req-7aed4c26-3601-4a97-9936-9431d71035b5 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001419 Oct 31 19:14:35.140708 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: [pid: 103694|app: 0|req: 28/55] 10.222.0.16 () {56 vars in 1074 bytes} [Mon Oct 31 19:14:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:14:35.656867 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi [None req-690875b2-20c7-4f4e-9277-dc8a79380930 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:14:35.675495 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: INFO nova.api.openstack.requestlog [None req-690875b2-20c7-4f4e-9277-dc8a79380930 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.398413 Oct 31 19:14:35.676041 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: [pid: 103693|app: 0|req: 28/56] 10.222.0.16 () {64 vars in 1235 bytes} [Mon Oct 31 19:14:35 2022] POST /compute/v2.1/flavors => generated 405 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 31 19:14:36.886730 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi [None req-7aed4c26-3601-4a97-9936-9431d71035b5 admin admin] Calling method '>' {{(pid=103694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:14:36.887725 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: INFO nova.api.openstack.requestlog [None req-7aed4c26-3601-4a97-9936-9431d71035b5 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001411 Oct 31 19:14:36.888116 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: [pid: 103694|app: 0|req: 29/57] 10.222.0.16 () {56 vars in 1074 bytes} [Mon Oct 31 19:14:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:14:37.400394 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi [None req-d6c61ed2-d171-4eb1-9621-8c93977fc9a2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:14:37.419610 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: INFO nova.api.openstack.requestlog [None req-d6c61ed2-d171-4eb1-9621-8c93977fc9a2 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.393218 Oct 31 19:14:37.420144 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: [pid: 103693|app: 0|req: 29/58] 10.222.0.16 () {64 vars in 1235 bytes} [Mon Oct 31 19:14:37 2022] POST /compute/v2.1/flavors => generated 407 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 19:14:38.615372 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi [None req-7aed4c26-3601-4a97-9936-9431d71035b5 admin admin] Calling method '>' {{(pid=103694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:14:38.616356 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: INFO nova.api.openstack.requestlog [None req-7aed4c26-3601-4a97-9936-9431d71035b5 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001412 Oct 31 19:14:38.616744 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: [pid: 103694|app: 0|req: 30/59] 10.222.0.16 () {56 vars in 1074 bytes} [Mon Oct 31 19:14:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:14:39.135548 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi [None req-e714ee94-7655-4b90-90a8-9f5eab31cc1f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:14:39.153349 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: INFO nova.api.openstack.requestlog [None req-e714ee94-7655-4b90-90a8-9f5eab31cc1f admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.398960 Oct 31 19:14:39.153926 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: [pid: 103693|app: 0|req: 30/60] 10.222.0.16 () {64 vars in 1235 bytes} [Mon Oct 31 19:14:38 2022] POST /compute/v2.1/flavors => generated 409 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 31 19:14:40.348747 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi [None req-7aed4c26-3601-4a97-9936-9431d71035b5 admin admin] Calling method '>' {{(pid=103694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:14:40.349778 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: INFO nova.api.openstack.requestlog [None req-7aed4c26-3601-4a97-9936-9431d71035b5 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001422 Oct 31 19:14:40.350176 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: [pid: 103694|app: 0|req: 31/61] 10.222.0.16 () {56 vars in 1074 bytes} [Mon Oct 31 19:14:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:14:40.897058 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi [None req-0b4ae284-091b-4259-9667-ab9b8cfdb838 admin admin] Calling method '>' {{(pid=103693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:14:40.918712 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: INFO nova.api.openstack.requestlog [None req-0b4ae284-091b-4259-9667-ab9b8cfdb838 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.430789 Oct 31 19:14:40.919256 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: [pid: 103693|app: 0|req: 31/62] 10.222.0.16 () {60 vars in 1202 bytes} [Mon Oct 31 19:14:40 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 19:15:37.322805 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi [None req-7aed4c26-3601-4a97-9936-9431d71035b5 admin admin] Calling method '>' {{(pid=103694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:15:37.323813 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: INFO nova.api.openstack.requestlog [None req-7aed4c26-3601-4a97-9936-9431d71035b5 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Oct 31 19:15:37.324207 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: [pid: 103694|app: 0|req: 32/63] 10.222.0.16 () {54 vars in 931 bytes} [Mon Oct 31 19:15:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:15:37.334576 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG dbcounter [-] [103693] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=103693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:15:37.710544 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi [None req-90892f74-155a-4f6f-b90d-127b41357d56 admin admin] Calling method '>' {{(pid=103693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:15:37.731207 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: INFO nova.api.openstack.requestlog [None req-90892f74-155a-4f6f-b90d-127b41357d56 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.401081 Oct 31 19:15:37.731738 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: [pid: 103693|app: 0|req: 32/64] 10.222.0.16 () {60 vars in 1292 bytes} [Mon Oct 31 19:15:37 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 19:15:37.753178 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG dbcounter [-] [103694] Writing DB stats nova_api:SELECT=14 {{(pid=103694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:15:37.756863 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi [None req-aede380a-0295-49c6-bac0-1be88562f8f1 admin admin] Calling method '>' {{(pid=103694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:15:37.764100 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: INFO nova.api.openstack.requestlog [None req-aede380a-0295-49c6-bac0-1be88562f8f1 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012430 Oct 31 19:15:37.765103 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: [pid: 103694|app: 0|req: 33/65] 10.222.0.16 () {60 vars in 1283 bytes} [Mon Oct 31 19:15:37 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:15:37.776553 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi [None req-cbf945bd-1f69-4d4d-9bf3-58eee94f2e41 admin admin] Calling method '>' {{(pid=103693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:15:37.784415 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: INFO nova.api.openstack.requestlog [None req-cbf945bd-1f69-4d4d-9bf3-58eee94f2e41 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011420 Oct 31 19:15:37.784938 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: [pid: 103693|app: 0|req: 33/66] 10.222.0.16 () {60 vars in 1286 bytes} [Mon Oct 31 19:15:37 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:15:37.796677 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi [None req-af1df6dd-c969-4252-87e4-081aae722a9e admin admin] Calling method '>' {{(pid=103694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:15:37.803893 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: INFO nova.api.openstack.requestlog [None req-af1df6dd-c969-4252-87e4-081aae722a9e admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010792 Oct 31 19:15:37.804408 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: [pid: 103694|app: 0|req: 34/67] 10.222.0.16 () {60 vars in 1286 bytes} [Mon Oct 31 19:15:37 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:15:37.815743 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi [None req-3d3b84de-2181-45e5-a42e-6516307eaf55 admin admin] Calling method '>' {{(pid=103693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:15:37.822892 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: INFO nova.api.openstack.requestlog [None req-3d3b84de-2181-45e5-a42e-6516307eaf55 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010651 Oct 31 19:15:37.823393 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: [pid: 103693|app: 0|req: 34/68] 10.222.0.16 () {60 vars in 1283 bytes} [Mon Oct 31 19:15:37 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:18:37.279083 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi [None req-af1df6dd-c969-4252-87e4-081aae722a9e admin admin] Calling method '>' {{(pid=103694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:18:37.280087 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: INFO nova.api.openstack.requestlog [None req-af1df6dd-c969-4252-87e4-081aae722a9e admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Oct 31 19:18:37.280478 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: [pid: 103694|app: 0|req: 35/69] 10.222.0.16 () {56 vars in 1074 bytes} [Mon Oct 31 19:18:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 19:18:37.420578 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG dbcounter [-] [103693] Writing DB stats nova_api:SELECT=6 {{(pid=103693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:18:37.577090 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi [None req-1991e5d8-6f08-4fb2-af1b-5315e57eae30 admin admin] Calling method '>' {{(pid=103693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:18:37.582480 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG oslo_concurrency.lockutils [None req-1991e5d8-6f08-4fb2-af1b-5315e57eae30 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:18:37.582968 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG oslo_concurrency.lockutils [None req-1991e5d8-6f08-4fb2-af1b-5315e57eae30 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:18:37.583456 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG oslo_concurrency.lockutils [None req-1991e5d8-6f08-4fb2-af1b-5315e57eae30 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:18:37.584197 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG oslo_concurrency.lockutils [None req-1991e5d8-6f08-4fb2-af1b-5315e57eae30 admin admin] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:18:37.584678 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG oslo_concurrency.lockutils [None req-1991e5d8-6f08-4fb2-af1b-5315e57eae30 admin admin] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:18:37.585110 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG oslo_concurrency.lockutils [None req-1991e5d8-6f08-4fb2-af1b-5315e57eae30 admin admin] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:18:37.616932 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: INFO nova.api.openstack.requestlog [None req-1991e5d8-6f08-4fb2-af1b-5315e57eae30 admin admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.197498 Oct 31 19:18:37.617500 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: [pid: 103693|app: 0|req: 35/70] 10.222.0.16 () {60 vars in 1193 bytes} [Mon Oct 31 19:18:37 2022] GET /compute/v2.1/os-services => generated 791 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 19:18:38.688764 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi [None req-af1df6dd-c969-4252-87e4-081aae722a9e admin admin] Calling method '>' {{(pid=103694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:18:38.689804 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: INFO nova.api.openstack.requestlog [None req-af1df6dd-c969-4252-87e4-081aae722a9e admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001909 Oct 31 19:18:38.690199 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: [pid: 103694|app: 0|req: 36/71] 10.222.0.16 () {56 vars in 1074 bytes} [Mon Oct 31 19:18:38 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:18:38.878363 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi [None req-f96284c0-89bb-4a76-a8bb-0c3bb563bc0a admin admin] Calling method '>' {{(pid=103693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:18:38.881752 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG oslo_concurrency.lockutils [None req-f96284c0-89bb-4a76-a8bb-0c3bb563bc0a admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:18:38.882229 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG oslo_concurrency.lockutils [None req-f96284c0-89bb-4a76-a8bb-0c3bb563bc0a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:18:38.882704 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG oslo_concurrency.lockutils [None req-f96284c0-89bb-4a76-a8bb-0c3bb563bc0a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:18:38.883407 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG oslo_concurrency.lockutils [None req-f96284c0-89bb-4a76-a8bb-0c3bb563bc0a admin admin] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:18:38.883883 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG oslo_concurrency.lockutils [None req-f96284c0-89bb-4a76-a8bb-0c3bb563bc0a admin admin] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:18:38.884292 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG oslo_concurrency.lockutils [None req-f96284c0-89bb-4a76-a8bb-0c3bb563bc0a admin admin] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:18:38.905688 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: INFO nova.api.openstack.requestlog [None req-f96284c0-89bb-4a76-a8bb-0c3bb563bc0a admin admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.078087 Oct 31 19:18:38.906205 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: [pid: 103693|app: 0|req: 36/72] 10.222.0.16 () {60 vars in 1193 bytes} [Mon Oct 31 19:18:38 2022] GET /compute/v2.1/os-services => generated 791 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 19:18:50.353575 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi [None req-af1df6dd-c969-4252-87e4-081aae722a9e admin admin] Calling method '>' {{(pid=103694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:18:50.354597 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: INFO nova.api.openstack.requestlog [None req-af1df6dd-c969-4252-87e4-081aae722a9e admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001511 Oct 31 19:18:50.354987 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: [pid: 103694|app: 0|req: 37/73] 10.222.0.16 () {56 vars in 1074 bytes} [Mon Oct 31 19:18:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:18:50.497162 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG dbcounter [-] [103693] Writing DB stats nova_cell0:SELECT=4 {{(pid=103693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:18:50.497895 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG dbcounter [-] [103693] Writing DB stats nova_cell1:SELECT=4 {{(pid=103693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:18:50.498509 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG dbcounter [-] [103693] Writing DB stats nova_api:SELECT=8 {{(pid=103693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:18:50.546448 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi [None req-d36cd33f-613f-4d7b-8c45-bc7a2de4f550 admin admin] Calling method '>' {{(pid=103693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:18:50.549904 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG oslo_concurrency.lockutils [None req-d36cd33f-613f-4d7b-8c45-bc7a2de4f550 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:18:50.550383 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG oslo_concurrency.lockutils [None req-d36cd33f-613f-4d7b-8c45-bc7a2de4f550 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:18:50.550810 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG oslo_concurrency.lockutils [None req-d36cd33f-613f-4d7b-8c45-bc7a2de4f550 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:18:50.551519 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG oslo_concurrency.lockutils [None req-d36cd33f-613f-4d7b-8c45-bc7a2de4f550 admin admin] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:18:50.551964 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG oslo_concurrency.lockutils [None req-d36cd33f-613f-4d7b-8c45-bc7a2de4f550 admin admin] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:18:50.552377 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG oslo_concurrency.lockutils [None req-d36cd33f-613f-4d7b-8c45-bc7a2de4f550 admin admin] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:18:50.576901 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: INFO nova.api.openstack.requestlog [None req-d36cd33f-613f-4d7b-8c45-bc7a2de4f550 admin admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.92 time: 0.084019 Oct 31 19:18:50.577385 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: [pid: 103693|app: 0|req: 37/74] 10.222.0.16 () {60 vars in 1193 bytes} [Mon Oct 31 19:18:50 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 19:18:51.635360 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG nova.api.openstack.wsgi [None req-af1df6dd-c969-4252-87e4-081aae722a9e admin admin] Calling method '>' {{(pid=103694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:18:51.636348 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: INFO nova.api.openstack.requestlog [None req-af1df6dd-c969-4252-87e4-081aae722a9e admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 Oct 31 19:18:51.636743 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: [pid: 103694|app: 0|req: 38/75] 10.222.0.16 () {56 vars in 1074 bytes} [Mon Oct 31 19:18:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:18:51.828575 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi [None req-b8b1940d-4b7b-4995-a025-517d801d4814 admin admin] Calling method '>' {{(pid=103693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:18:51.831963 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG oslo_concurrency.lockutils [None req-b8b1940d-4b7b-4995-a025-517d801d4814 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:18:51.832436 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG oslo_concurrency.lockutils [None req-b8b1940d-4b7b-4995-a025-517d801d4814 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:18:51.832879 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG oslo_concurrency.lockutils [None req-b8b1940d-4b7b-4995-a025-517d801d4814 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:18:51.833578 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG oslo_concurrency.lockutils [None req-b8b1940d-4b7b-4995-a025-517d801d4814 admin admin] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:18:51.834038 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG oslo_concurrency.lockutils [None req-b8b1940d-4b7b-4995-a025-517d801d4814 admin admin] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:18:51.834443 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: DEBUG oslo_concurrency.lockutils [None req-b8b1940d-4b7b-4995-a025-517d801d4814 admin admin] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:18:51.855271 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: INFO nova.api.openstack.requestlog [None req-b8b1940d-4b7b-4995-a025-517d801d4814 admin admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.92 time: 0.078274 Oct 31 19:18:51.855750 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: [pid: 103693|app: 0|req: 38/76] 10.222.0.16 () {60 vars in 1193 bytes} [Mon Oct 31 19:18:51 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 19:19:50.131487 dv-cinder-863097-1-iscsi devstack@n-api.service[103692]: Mon Oct 31 19:19:50 2022 - graceful shutdown triggered... Oct 31 19:19:50.132043 dv-cinder-863097-1-iscsi devstack@n-api.service[103693]: Gracefully killing worker 1 (pid: 103693)... Oct 31 19:19:50.131756 dv-cinder-863097-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Oct 31 19:19:50.132875 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: Gracefully killing worker 2 (pid: 103694)... Oct 31 19:19:50.258952 dv-cinder-863097-1-iscsi devstack@n-api.service[103694]: DEBUG dbcounter [-] [103694] Writing DB stats nova_api:SELECT=4 {{(pid=103694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:19:51.132616 dv-cinder-863097-1-iscsi devstack@n-api.service[103692]: worker 1 buried after 1 seconds Oct 31 19:19:51.132616 dv-cinder-863097-1-iscsi devstack@n-api.service[103692]: worker 2 buried after 1 seconds Oct 31 19:19:51.132616 dv-cinder-863097-1-iscsi devstack@n-api.service[103692]: goodbye to uWSGI. Oct 31 19:19:51.134184 dv-cinder-863097-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Oct 31 19:19:51.134724 dv-cinder-863097-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Oct 31 19:19:51.137365 dv-cinder-863097-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Oct 31 19:19:51.150879 dv-cinder-863097-1-iscsi devstack@n-api.service[118708]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 31 19:19:51.153424 dv-cinder-863097-1-iscsi devstack@n-api.service[118708]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Oct 31 19:19:51 2022] *** Oct 31 19:19:51.153424 dv-cinder-863097-1-iscsi devstack@n-api.service[118708]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 31 19:19:51.153424 dv-cinder-863097-1-iscsi devstack@n-api.service[118708]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 31 19:19:51.153424 dv-cinder-863097-1-iscsi devstack@n-api.service[118708]: nodename: dv-cinder-863097-1-iscsi Oct 31 19:19:51.153424 dv-cinder-863097-1-iscsi devstack@n-api.service[118708]: machine: x86_64 Oct 31 19:19:51.153424 dv-cinder-863097-1-iscsi devstack@n-api.service[118708]: clock source: unix Oct 31 19:19:51.153424 dv-cinder-863097-1-iscsi devstack@n-api.service[118708]: pcre jit disabled Oct 31 19:19:51.153424 dv-cinder-863097-1-iscsi devstack@n-api.service[118708]: detected number of CPU cores: 4 Oct 31 19:19:51.153424 dv-cinder-863097-1-iscsi devstack@n-api.service[118708]: current working directory: / Oct 31 19:19:51.153424 dv-cinder-863097-1-iscsi devstack@n-api.service[118708]: detected binary path: /usr/bin/uwsgi-core Oct 31 19:19:51.153424 dv-cinder-863097-1-iscsi devstack@n-api.service[118708]: your processes number limit is 47680 Oct 31 19:19:51.154621 dv-cinder-863097-1-iscsi devstack@n-api.service[118708]: your memory page size is 4096 bytes Oct 31 19:19:51.154621 dv-cinder-863097-1-iscsi devstack@n-api.service[118708]: detected max file descriptor number: 2048 Oct 31 19:19:51.154621 dv-cinder-863097-1-iscsi devstack@n-api.service[118708]: lock engine: pthread robust mutexes Oct 31 19:19:51.154621 dv-cinder-863097-1-iscsi devstack@n-api.service[118708]: thunder lock: enabled Oct 31 19:19:51.154621 dv-cinder-863097-1-iscsi devstack@n-api.service[118708]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 31 19:19:51.154621 dv-cinder-863097-1-iscsi devstack@n-api.service[118708]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 31 19:19:51.195485 dv-cinder-863097-1-iscsi devstack@n-api.service[118708]: Python main interpreter initialized at 0x55708ecf69c0 Oct 31 19:19:51.195485 dv-cinder-863097-1-iscsi devstack@n-api.service[118708]: python threads support enabled Oct 31 19:19:51.195485 dv-cinder-863097-1-iscsi devstack@n-api.service[118708]: your server socket listen backlog is limited to 100 connections Oct 31 19:19:51.195485 dv-cinder-863097-1-iscsi devstack@n-api.service[118708]: your mercy for graceful operations on workers is 90 seconds Oct 31 19:19:51.195923 dv-cinder-863097-1-iscsi devstack@n-api.service[118708]: mapped 403077 bytes (393 KB) for 2 cores Oct 31 19:19:51.195923 dv-cinder-863097-1-iscsi devstack@n-api.service[118708]: *** Operational MODE: preforking *** Oct 31 19:19:51.196218 dv-cinder-863097-1-iscsi devstack@n-api.service[118708]: *** uWSGI is running in multiple interpreter mode *** Oct 31 19:19:51.196218 dv-cinder-863097-1-iscsi devstack@n-api.service[118708]: spawned uWSGI master process (pid: 118708) Oct 31 19:19:51.196427 dv-cinder-863097-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Oct 31 19:19:51.199431 dv-cinder-863097-1-iscsi devstack@n-api.service[118708]: spawned uWSGI worker 1 (pid: 118726, cores: 1) Oct 31 19:19:51.199775 dv-cinder-863097-1-iscsi devstack@n-api.service[118708]: spawned uWSGI worker 2 (pid: 118727, cores: 1) Oct 31 19:19:51.199952 dv-cinder-863097-1-iscsi devstack@n-api.service[118708]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 31 19:19:51.854697 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 31 19:19:51.858465 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 31 19:19:53.083445 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 31 19:19:53.083445 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: from cryptography.utils import int_from_bytes Oct 31 19:19:53.084041 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 31 19:19:53.084041 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: from cryptography.utils import int_from_bytes Oct 31 19:19:53.096423 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 31 19:19:53.096423 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: from cryptography.utils import int_from_bytes Oct 31 19:19:53.096971 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 31 19:19:53.096971 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: from cryptography.utils import int_from_bytes Oct 31 19:19:55.507446 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 31 19:19:55.507949 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 31 19:19:55.508237 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 31 19:19:55.508946 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 31 19:19:55.508946 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 31 19:19:55.509118 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.509414 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.509776 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.510093 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.510419 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.510858 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.511026 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.511344 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.511668 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.511929 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.512242 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.512564 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-863097-1-iscsi {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.512881 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.513185 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.513493 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.513841 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.514144 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.514466 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.514766 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.515256 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.516695 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.516695 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.516695 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.517035 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.517264 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.517518 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.517867 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.518200 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.518501 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.518831 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.519215 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-863097-1-iscsi {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.519514 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.519812 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.520112 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.520527 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.520839 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.521168 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.521465 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.521825 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.522228 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.522467 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.522788 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.523105 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.523426 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.523728 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.524032 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.524137 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 31 19:19:55.524532 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.524615 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 31 19:19:55.524704 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.524862 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 31 19:19:55.524963 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.525222 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.525325 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 31 19:19:55.525467 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.525577 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 31 19:19:55.525797 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.525892 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.526114 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.526216 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.526431 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.526530 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.526748 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.526853 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.526997 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.527159 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.527255 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.527432 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.527530 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.527754 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.527852 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.528074 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.528173 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.528403 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.528512 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.528667 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.528759 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.528982 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.529074 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.529297 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.529394 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-863097-1-iscsi {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.529599 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.529710 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.529922 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.530022 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.530224 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.530323 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.530537 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.530684 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.530842 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.530933 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.531156 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.531261 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.531459 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.531559 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.531771 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.531966 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.532168 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.532293 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.532409 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.532574 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.532709 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.532886 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.533043 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.533224 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.533353 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.533538 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.533696 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.533878 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.534013 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.534200 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.534331 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.534511 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.534633 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.534834 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.534926 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.535144 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.535254 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.535518 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.535618 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-863097-1-iscsi {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.535846 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.535986 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.536147 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.536283 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.536412 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.536508 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.536676 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.537025 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.537157 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.537245 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.537334 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.537458 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.537568 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.538323 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.538434 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.538656 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.538748 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.538968 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.539109 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.539272 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.539371 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.539573 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.539676 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.539871 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.539975 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.540171 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.540267 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.540472 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.540565 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.540771 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.540873 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.541069 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.541161 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.541700 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.541833 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.542010 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.542179 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.542348 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.542498 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.542642 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.542781 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.542925 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.543071 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.543218 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.543364 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.543513 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.543653 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.543793 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.543959 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.544099 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.544250 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.544353 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.544428 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.544552 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.544644 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.548142 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.548362 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.548536 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.548702 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.548856 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.549004 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.549148 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.549314 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.549698 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.549853 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.550009 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.550162 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.550306 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.550460 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.550611 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.550909 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.551064 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.551168 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.551270 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.551362 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.551454 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.551534 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.551534 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.551696 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.551840 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.551937 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.552028 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.552113 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.552251 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.552340 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.552434 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.552572 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.552661 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.552745 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.552835 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.552919 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.553011 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.553143 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.553230 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.553324 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.553408 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.553554 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.554159 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.554256 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.554341 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.554424 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.554514 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.554616 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.554708 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.554793 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.554875 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.554966 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.555063 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.555156 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.555241 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.555414 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.555414 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.555579 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.555663 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.555754 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.555845 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.555928 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.556018 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.556109 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.556257 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.556343 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.556472 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.556561 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.556651 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.556734 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.556832 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.556915 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.556998 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.557129 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.557218 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.557308 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.557406 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.557519 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.557655 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.557742 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.557842 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.557982 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.558121 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.558255 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.558393 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.558529 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.558624 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.558707 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.558803 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.558897 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.558988 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.559071 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.559161 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.559383 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.559485 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.559705 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.559808 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.560006 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.560104 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.560308 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.560400 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.560611 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.560714 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.560931 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.561034 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.561235 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.561327 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.561539 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.561666 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.561882 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.562025 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.562188 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.562324 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.562543 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.562659 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.562794 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.562885 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.563097 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.563232 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.563403 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.563504 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.563721 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.563812 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.564020 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.564122 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.564330 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.564429 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.564646 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.564745 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.564949 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.565049 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.565254 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.565345 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.565557 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.565720 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.565885 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.565978 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.566190 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.566296 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.566492 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.566590 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.566795 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.566887 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.567101 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.567201 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.567399 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.567504 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.567718 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.567816 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.568032 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.568139 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.568337 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.568435 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.568642 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.568740 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.568947 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.569038 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.569274 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.569364 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 19:19:55.569575 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.569732 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.569904 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.570009 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.570211 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.570310 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.570511 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.570613 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.570830 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.570931 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.571156 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.571248 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.571459 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.571558 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.571788 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.571889 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.572091 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.572191 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.572398 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.572504 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.572706 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.572811 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.573012 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.573112 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.573313 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.573420 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.573635 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.573731 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.573947 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.574039 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.574247 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.574359 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.574571 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.574664 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.574878 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.574978 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.575178 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.575281 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.575497 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.575596 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.575798 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.575902 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.576100 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.576202 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.576409 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.576501 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.576718 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.576809 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.577023 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.577124 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.577332 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.577437 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.577659 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.577754 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.577981 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.578075 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.578289 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.578388 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.578595 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.578701 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.578925 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.579018 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.579251 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.579353 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.579550 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.579656 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.579870 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.579970 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.580191 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.580285 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.580502 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.580652 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.580801 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.580901 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.581107 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.581203 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.581405 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.581512 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.581729 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.581839 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.582031 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.582131 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.582340 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.582447 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.582637 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.582753 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.582939 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.583043 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.583235 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.583328 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.583534 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.583630 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.583833 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.583933 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.584152 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.584248 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.584464 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.584564 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.584786 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.584881 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.585086 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.585178 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.585384 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.585483 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.585730 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.585871 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.586039 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.586175 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.586344 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.586441 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.586656 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.586762 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.586960 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.587059 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.587283 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.587374 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.587594 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.587702 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.587907 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.588004 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.588212 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.588301 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.588520 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.588626 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.588827 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.588926 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.589135 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.589227 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.589445 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.589546 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.589774 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.589881 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.590088 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.590231 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.590394 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.590495 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.590696 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.590788 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.591010 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.591151 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.591321 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.591419 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.591621 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.591719 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.591936 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.592035 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.592239 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.592365 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.592545 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.592671 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.592861 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.592980 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.593229 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.593334 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.593485 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.593584 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.593821 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.593929 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.594130 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.594224 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.594443 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.594547 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.594749 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.594856 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.595056 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.595156 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.595369 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.595462 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.595676 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.595813 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.595990 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.596085 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.596297 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.596424 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.596614 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.596724 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.596922 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.597015 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.597224 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.597322 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.597522 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.597707 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.597851 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.597953 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.598157 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.598250 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.598462 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.598554 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.598771 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.598863 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.599075 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.599175 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.599380 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.599472 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.599683 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.599780 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.599996 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.600094 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.600287 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.600898 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.601099 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.601228 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.601401 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.601493 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.601732 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.601827 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.602038 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.602142 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.602342 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.602448 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.602646 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.602781 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.602948 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.603041 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.603258 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.603364 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.603563 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.603705 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.603862 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.603954 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.604161 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.604266 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.604466 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.604558 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.604786 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.604878 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.605092 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.605192 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.605409 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.605503 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.605759 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.605865 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.606063 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.606166 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.606362 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.606453 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.606679 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.606813 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.606984 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.607076 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.607282 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.607373 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.607581 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.607717 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.607879 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.608008 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.608218 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.608314 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.608528 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.608653 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.608824 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.608952 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.609178 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.609419 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.609523 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.609770 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.609877 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.610084 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.610255 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.610400 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.610493 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.610713 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.610815 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.611023 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.611116 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.611344 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.611435 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.611655 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.611754 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.611961 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.612057 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.612268 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.612359 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.612577 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.612714 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.612886 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.612978 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.613196 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.613286 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.613512 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.613642 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.613846 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.613940 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.614152 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.614252 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.614456 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.614552 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.614763 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.614857 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.615071 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.615178 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.615386 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.615485 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.615708 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.615982 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.616572 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.616863 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.616963 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.617173 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.617262 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.617482 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.617675 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.617819 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.617913 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.618125 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.618236 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.618431 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.618526 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.618742 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.618834 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.619056 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.619165 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.619357 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.619447 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.619665 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.619765 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.619970 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.620076 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.620263 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.620355 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.620569 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.620681 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.620867 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.620988 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.621168 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.621259 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.621468 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.621559 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.621803 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.621899 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.622103 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.622196 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.622402 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.622493 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.622702 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.622848 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.623005 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.623097 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.623313 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.623417 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.623610 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.623708 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.623917 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.624032 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.624217 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.624324 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.624518 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.624616 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.624828 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.624919 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.625126 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.625266 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.625425 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.625567 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.625749 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.625856 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.626090 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.626194 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.626393 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.626496 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.626710 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.626814 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.627027 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.627120 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.627342 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.627434 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.627650 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.627741 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.627951 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.628044 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.628272 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.628370 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.628572 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.628674 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.628870 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.628971 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.629170 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.629271 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.629476 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.629569 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.629809 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.629909 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.630106 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.630197 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.630411 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.630516 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.630715 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.630818 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.631020 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.631112 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.631323 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.631424 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.631642 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.631752 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.631947 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.632040 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.632245 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.632525 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.632618 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.632842 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.632978 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.633139 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.633233 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.633435 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.633535 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.633844 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.633987 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.634076 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.634175 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.634336 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.634430 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.634640 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.634747 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.634942 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.635059 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.635250 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.635350 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.635547 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.635653 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.635844 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.635938 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.636139 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.636231 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.636442 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.636535 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.636746 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.636838 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.637042 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.637172 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.637359 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.637489 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.637687 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.637808 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.637988 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.638120 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.638268 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.638365 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.638576 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.638678 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.638872 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.638966 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.639167 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.639261 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.639470 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.639564 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.639785 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.639875 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.640092 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.640186 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.640385 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.640476 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.640727 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.640843 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.640983 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.641076 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.641281 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.641382 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.641579 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.641735 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.641905 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.641998 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.642201 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.642296 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.642496 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.642601 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.642791 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.642885 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.643088 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.643212 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.643370 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.643520 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.643687 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.643825 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.643990 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.644150 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.644288 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.644456 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.644589 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.644768 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.644890 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.645074 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.645226 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.645386 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.645524 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.645722 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.645898 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.646050 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.646193 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.646323 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.646503 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.646633 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.646817 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.646944 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.647123 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.647278 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.647453 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.647580 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.647762 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.647891 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.648062 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.648195 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.648371 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.648510 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.648676 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.648819 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.648983 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.649123 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.649280 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.649424 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.649576 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.649758 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.649917 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.650068 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.650226 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.650370 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.650533 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.650663 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.650877 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.651006 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.651164 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.651293 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.651483 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.651584 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.651782 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.651876 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.652090 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.652228 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.652397 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.652497 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.652703 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.652796 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.653010 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.653114 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.653317 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.653453 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.653645 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.653742 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.653946 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.654048 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.654251 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.654355 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.654556 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.654647 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.654862 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.654963 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.655164 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.655263 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.655471 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.655569 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.655775 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.655868 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.656075 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.656176 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.656387 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.656485 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.656691 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.656784 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.656991 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.657090 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.657294 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.657394 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.657591 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.657709 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.657916 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.658017 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.658215 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.658314 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.658518 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.658820 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.658919 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.659123 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.659215 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.659424 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.659518 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.659745 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.659838 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.660053 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.660145 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.660356 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.660457 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.660660 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.660752 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.660966 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.661093 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.661277 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.661369 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.661642 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.661757 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.661988 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.662090 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.662296 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.662398 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.662602 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.662706 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.663430 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.663554 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.663721 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.663814 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.664029 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.664132 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.664342 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.664451 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.664640 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.664741 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.664941 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.665034 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.665246 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.665349 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.665556 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.665674 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.665883 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.665976 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.666187 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.666551 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.666773 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.666872 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.667086 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.667178 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.667398 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.667499 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.667721 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.667856 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.668043 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.668169 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.668368 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.668470 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.668673 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.668768 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.668986 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.669132 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.669288 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.669429 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.669595 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.669737 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.669923 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.670015 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.670235 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.670329 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.670545 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.670638 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.670856 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.671126 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.671236 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.671323 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.671464 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.671565 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.671772 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.671880 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.672080 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.672307 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.672406 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.672501 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.672689 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.672793 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.672995 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.673089 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.673321 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.673425 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.673653 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.673768 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.673961 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.674070 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.674273 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.674411 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.674578 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.674680 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.674886 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.674980 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.675194 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.675287 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.675508 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.675810 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.675902 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.676111 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.676854 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.676960 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.677084 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.677189 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.677277 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.677362 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.677460 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.677546 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.678260 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.678373 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.678509 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.679086 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.679211 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.679287 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.679373 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.679457 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.679552 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.679639 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.679732 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.679826 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.679913 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.679997 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.680135 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.680264 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.680442 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.680584 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.680748 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.680888 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.681060 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.681205 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.681387 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.681484 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.681714 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.681830 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.682023 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.682171 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.682329 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.682423 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.682653 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.682745 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.682957 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.683070 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.683280 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.683374 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.683616 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.683746 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.683944 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.684039 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.684253 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.684357 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.684580 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.684681 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.684902 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.684996 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.685220 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.685321 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.685534 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.685658 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.685876 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.685981 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.686198 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.686292 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.686499 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.686599 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.686799 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.686901 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.687106 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.687207 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.687406 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.687512 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.687706 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.687813 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.688005 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.688152 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.688310 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.688414 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.688608 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.688701 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.688905 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.689006 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.689203 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.689342 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.689521 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.689656 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.689845 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.689948 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.690164 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.690318 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.690470 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.690642 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.690769 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.690954 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.691063 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.691275 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.691415 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.691604 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.691697 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.691911 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.692012 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.692218 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.692312 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.692532 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.692634 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.692839 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.693015 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.693146 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.693247 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.693470 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.693564 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.693800 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.693953 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.694138 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.694260 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.694445 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.694552 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.694756 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.694869 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.695058 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.695151 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.695367 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.695467 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.695679 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.695773 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.695981 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.696072 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.696292 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.696387 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.696609 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.696816 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.696925 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.697141 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.697241 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.697451 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.697553 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.697787 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.697891 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.698115 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.698210 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.698407 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.698501 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.698714 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.698808 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.699022 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.699116 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.699333 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.699516 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.699692 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.699836 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.700002 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.700158 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.700260 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.700352 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.700551 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.700652 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.700872 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.700981 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.701202 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.701297 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.701517 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.701658 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.701852 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.701958 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.702161 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.702257 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.702473 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.702571 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.702796 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.702902 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.703104 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.703197 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.703407 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.703499 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.703717 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.703818 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.704024 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.704128 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.704328 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.704423 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.704635 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.704749 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.704939 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.705052 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.705245 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.705345 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.705548 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.705669 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.705875 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.705984 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.706177 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.706279 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.706484 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.706577 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.706792 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.706892 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.707100 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.707204 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.707406 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.707499 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.707712 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.707814 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.708013 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.708114 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.708325 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.708417 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.708634 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.708722 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.708961 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.709151 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.709272 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.709466 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.709595 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.709848 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.709963 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.710173 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.710282 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.710495 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.710587 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.710808 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.710911 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.711122 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.711215 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.711450 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.711568 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.711752 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.711908 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.712049 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.712190 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.712350 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.712513 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.712653 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.712813 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.712953 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.713093 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.713233 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.713487 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.713680 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.713841 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.713935 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.714159 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.714264 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.714464 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.714571 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.714780 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.714998 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.715098 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.715348 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.715449 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.715659 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.715753 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.715979 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.716072 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.716299 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.716400 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.716610 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.716703 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.716910 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.717000 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.717229 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.717331 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.717531 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.717655 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.717862 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.718010 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.718172 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.718281 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.718478 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.718570 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.718776 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.718868 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.719073 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.719179 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.719381 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.719501 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.719688 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.719784 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.719988 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.720084 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.720293 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.720393 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.720592 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.720685 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.720913 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.721018 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.721212 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.721313 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.721526 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.721681 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.721857 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.721947 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.722131 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.722310 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.722465 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.722618 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.722712 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.722798 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.723000 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.723105 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.723298 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.723407 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.723605 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.723700 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.723903 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.724008 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.724209 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.724361 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.724515 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.724613 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.724814 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.724955 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.725148 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.725244 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.725988 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.726271 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.726364 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.726595 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.726703 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.726895 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.726988 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.727194 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.727288 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.727506 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.727611 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.727814 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.727915 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.728131 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.728226 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.728438 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.728554 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.728741 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.728842 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.729074 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.729174 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.729386 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.729487 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.729724 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.729943 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.730093 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.730274 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.730384 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.730592 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.730685 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.730922 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.731014 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.731243 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.731371 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.731544 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.731662 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.731846 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.732079 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.732187 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.732431 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.732536 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.732748 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.732843 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.733055 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.733168 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.733366 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.733461 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.733696 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.733792 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.734007 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.734114 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.734394 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.734502 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.734622 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.734723 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.734994 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.735114 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.735233 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.735327 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.735541 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.735898 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.735898 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.736095 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.736188 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.736281 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.736434 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.736530 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.736737 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.736839 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.737039 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.737140 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.737352 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.737446 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.737676 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.737788 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.738006 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.738098 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.738316 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.738436 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.738619 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.738717 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.738923 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.739023 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.739228 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.739329 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.739532 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.739623 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.739833 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.739932 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.740137 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.740241 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.740440 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.740533 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.740756 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.740849 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.741638 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.741752 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.741950 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.742076 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.742257 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.742389 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.742572 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.742707 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.742933 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.743025 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.743246 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.743339 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.743552 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.743646 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.743878 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.743971 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.744186 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.744285 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.744488 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.744633 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.744800 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.744902 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.745118 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.745255 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.745442 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.745557 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.745794 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.745900 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.746106 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.746264 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.746407 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.746546 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.746686 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.746834 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.746980 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.747273 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.747420 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.747570 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.747722 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.747868 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.748008 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.748159 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.748305 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.748452 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.748603 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.748741 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.748844 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.749041 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.749145 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.749340 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.749435 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.749662 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.749779 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.749967 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.750075 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.750274 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.750431 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.750574 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.750725 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.750874 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.751023 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.751163 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.751305 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.751454 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.751668 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.751810 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.751969 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.752108 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.752250 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.752404 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.752552 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.752688 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.752829 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.752965 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.753105 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.753254 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.753406 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.753559 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.753713 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.753863 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.754009 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.754157 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.754295 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.754443 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.754601 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.754757 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.754914 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.755065 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.755237 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.755385 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.755528 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.755674 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.755824 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.755968 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.756108 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.756247 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.756423 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.756561 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.756758 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.756901 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.757068 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.757219 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.757385 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.757572 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.757754 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.757906 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.758057 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.758203 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.758342 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.758506 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.758637 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.758730 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.758946 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.759040 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.759257 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.759364 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.759566 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.759671 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.759890 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.759990 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.760193 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.760302 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.760514 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.760613 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.760828 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.760929 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.761143 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.761238 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.761460 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.761560 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.761791 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.761895 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.762118 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.762211 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.762427 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.762527 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.762735 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.762829 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.763046 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.763140 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.763352 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.763444 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.763661 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.763762 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.763970 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.764069 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.764276 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.764393 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.764584 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.764688 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.764888 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.764983 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.765191 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.765283 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.765501 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.765676 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.765838 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.765945 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.766142 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.766243 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.766447 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.766550 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.766752 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.766845 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.767082 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.767214 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.767367 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.767463 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.767671 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.767771 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.767977 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.768070 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.768282 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.768375 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.768586 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.768686 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.768890 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.769000 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.769148 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 31 19:19:55.769248 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.769491 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.769819 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.770125 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.770432 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.770736 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.771075 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.771408 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.771725 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.772052 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.772896 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.773204 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.773514 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.773865 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.774189 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.774506 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.774879 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.775139 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.775468 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.775759 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.776075 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.776397 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.776712 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.777025 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.777338 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.777689 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.777997 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.778324 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.778645 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.778965 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.779283 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.779597 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.779929 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.780242 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.780554 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.780867 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.781179 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.781490 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.781832 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.782145 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.782456 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.782773 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.783091 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.783419 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.783748 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.784060 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.784386 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.784714 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.785063 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.785379 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.785744 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.786077 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.786399 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.786715 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.787024 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 19:19:55.787270 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 31 19:19:55.831923 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO dbcounter [None req-c25732b5-f192-4402-8f0c-4408434a8394 None None] Registered counter for database nova_api Oct 31 19:19:55.852181 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO dbcounter [None req-ab468baf-51bf-44ce-8291-e790f9d40f2c None None] Registered counter for database nova_api Oct 31 19:19:55.852963 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_db.sqlalchemy.engines [None req-c25732b5-f192-4402-8f0c-4408434a8394 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118727) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 31 19:19:55.859638 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG dbcounter [-] [118727] Writer thread running {{(pid=118727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 31 19:19:55.871797 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_db.sqlalchemy.engines [None req-ab468baf-51bf-44ce-8291-e790f9d40f2c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118726) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 31 19:19:55.878367 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG dbcounter [-] [118726] Writer thread running {{(pid=118726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 31 19:19:55.916724 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.context [None req-c25732b5-f192-4402-8f0c-4408434a8394 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c28e7eb5-b4d6-491e-b19a-55ca88f41a3d(cell1) {{(pid=118727) load_cells /opt/stack/nova/nova/context.py:464}} Oct 31 19:19:55.920753 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-c25732b5-f192-4402-8f0c-4408434a8394 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:19:55.921225 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-c25732b5-f192-4402-8f0c-4408434a8394 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:19:55.922825 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-c25732b5-f192-4402-8f0c-4408434a8394 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:19:55.923540 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-c25732b5-f192-4402-8f0c-4408434a8394 None None] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:19:55.923983 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-c25732b5-f192-4402-8f0c-4408434a8394 None None] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:19:55.926016 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-c25732b5-f192-4402-8f0c-4408434a8394 None None] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:19:55.928006 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO dbcounter [None req-c25732b5-f192-4402-8f0c-4408434a8394 None None] Registered counter for database nova_cell0 Oct 31 19:19:55.932206 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO dbcounter [None req-c25732b5-f192-4402-8f0c-4408434a8394 None None] Registered counter for database nova_cell1 Oct 31 19:19:55.935962 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.context [None req-ab468baf-51bf-44ce-8291-e790f9d40f2c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c28e7eb5-b4d6-491e-b19a-55ca88f41a3d(cell1) {{(pid=118726) load_cells /opt/stack/nova/nova/context.py:464}} Oct 31 19:19:55.939832 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_db.sqlalchemy.engines [None req-c25732b5-f192-4402-8f0c-4408434a8394 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118727) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 31 19:19:55.940076 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-ab468baf-51bf-44ce-8291-e790f9d40f2c None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:19:55.940523 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-ab468baf-51bf-44ce-8291-e790f9d40f2c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:19:55.942036 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_db.sqlalchemy.engines [None req-c25732b5-f192-4402-8f0c-4408434a8394 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118727) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 31 19:19:55.942175 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-ab468baf-51bf-44ce-8291-e790f9d40f2c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:19:55.942927 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-ab468baf-51bf-44ce-8291-e790f9d40f2c None None] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:19:55.943374 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-ab468baf-51bf-44ce-8291-e790f9d40f2c None None] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:19:55.945455 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-ab468baf-51bf-44ce-8291-e790f9d40f2c None None] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:19:55.947519 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO dbcounter [None req-ab468baf-51bf-44ce-8291-e790f9d40f2c None None] Registered counter for database nova_cell0 Oct 31 19:19:55.948885 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG dbcounter [-] [118727] Writer thread running {{(pid=118727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 31 19:19:55.950176 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG dbcounter [-] [118727] Writer thread running {{(pid=118727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 31 19:19:55.951787 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO dbcounter [None req-ab468baf-51bf-44ce-8291-e790f9d40f2c None None] Registered counter for database nova_cell1 Oct 31 19:19:55.961323 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_db.sqlalchemy.engines [None req-ab468baf-51bf-44ce-8291-e790f9d40f2c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118726) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 31 19:19:55.962118 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_db.sqlalchemy.engines [None req-ab468baf-51bf-44ce-8291-e790f9d40f2c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118726) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 31 19:19:55.968259 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG dbcounter [-] [118726] Writer thread running {{(pid=118726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 31 19:19:56.095230 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO dbcounter [None req-c25732b5-f192-4402-8f0c-4408434a8394 None None] Registered counter for database nova_cell0 Oct 31 19:19:56.102916 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_db.sqlalchemy.engines [None req-c25732b5-f192-4402-8f0c-4408434a8394 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118727) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 31 19:19:56.107342 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG dbcounter [-] [118727] Writer thread running {{(pid=118727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 31 19:19:56.107494 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG dbcounter [-] [118726] Writer thread running {{(pid=118726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 31 19:19:56.117504 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO dbcounter [None req-ab468baf-51bf-44ce-8291-e790f9d40f2c None None] Registered counter for database nova_cell0 Oct 31 19:19:56.126277 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_db.sqlalchemy.engines [None req-ab468baf-51bf-44ce-8291-e790f9d40f2c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118726) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 31 19:19:56.130709 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG dbcounter [-] [118726] Writer thread running {{(pid=118726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 31 19:19:56.423825 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: WARNING keystonemiddleware.auth_token [None req-c25732b5-f192-4402-8f0c-4408434a8394 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 31 19:19:56.431197 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: WARNING keystonemiddleware.auth_token [None req-c25732b5-f192-4402-8f0c-4408434a8394 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 31 19:19:56.450561 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: WARNING keystonemiddleware.auth_token [None req-ab468baf-51bf-44ce-8291-e790f9d40f2c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 31 19:19:56.458368 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: WARNING keystonemiddleware.auth_token [None req-ab468baf-51bf-44ce-8291-e790f9d40f2c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 31 19:19:56.774960 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: WARNING keystonemiddleware.auth_token [None req-c25732b5-f192-4402-8f0c-4408434a8394 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 31 19:19:56.780885 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: WARNING keystonemiddleware.auth_token [None req-c25732b5-f192-4402-8f0c-4408434a8394 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 31 19:19:56.786175 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55708ecf69c0 pid: 118727 (default app) Oct 31 19:19:56.803244 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: WARNING keystonemiddleware.auth_token [None req-ab468baf-51bf-44ce-8291-e790f9d40f2c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 31 19:19:56.809813 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: WARNING keystonemiddleware.auth_token [None req-ab468baf-51bf-44ce-8291-e790f9d40f2c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 31 19:19:56.815095 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55708ecf69c0 pid: 118726 (default app) Oct 31 19:20:32.836725 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG dbcounter [-] [118727] Writing DB stats nova_api:SELECT=3 {{(pid=118727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:20:32.837776 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG dbcounter [-] [118727] Writing DB stats nova_cell0:SELECT=3 {{(pid=118727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:20:32.839994 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG dbcounter [-] [118727] Writing DB stats nova_cell1:SELECT=3 {{(pid=118727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:20:32.840722 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG dbcounter [-] [118727] Writing DB stats nova_cell0:SELECT=3 {{(pid=118727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:20:34.303470 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-fd564dde-46c5-4d31-8327-24196661a9d9 tempest-VolumesGetTestJSON-1189122356 tempest-VolumesGetTestJSON-1189122356-project] Action: 'create', calling method: .version_select at 0x7f34f3078ee0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1495971199", "metadata": {"Type": "work"}}} {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:20:36.214071 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-fd564dde-46c5-4d31-8327-24196661a9d9 tempest-VolumesGetTestJSON-1189122356 tempest-VolumesGetTestJSON-1189122356-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 3.383135 Oct 31 19:20:36.215677 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 1/1] 10.222.0.16 () {60 vars in 1156 bytes} [Mon Oct 31 19:20:32 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 3386 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 31 19:20:36.234665 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG dbcounter [-] [118726] Writing DB stats nova_api:SELECT=3 {{(pid=118726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:20:36.236413 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG dbcounter [-] [118726] Writing DB stats nova_cell0:SELECT=3 {{(pid=118726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:20:36.237438 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG dbcounter [-] [118726] Writing DB stats nova_cell1:SELECT=3 {{(pid=118726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:20:36.239665 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG dbcounter [-] [118726] Writing DB stats nova_cell0:SELECT=3 {{(pid=118726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:20:36.673833 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-755f36d7-65b8-47b8-a307-f67587c1525a tempest-VolumesGetTestJSON-1189122356 tempest-VolumesGetTestJSON-1189122356-project] Calling method '.version_select at 0x7f34f2ff3b80>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:20:37.331198 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-755f36d7-65b8-47b8-a307-f67587c1525a tempest-VolumesGetTestJSON-1189122356 tempest-VolumesGetTestJSON-1189122356-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/f5e02104-a72f-4c3e-8804-82616124d5d6" status: 200 len: 354 microversion: 2.1 time: 1.101808 Oct 31 19:20:37.333536 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 1/2] 10.222.0.16 () {58 vars in 1245 bytes} [Mon Oct 31 19:20:36 2022] GET /compute/v2.1/os-volumes/f5e02104-a72f-4c3e-8804-82616124d5d6 => generated 354 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:20:37.353619 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-6166f57d-91ac-43ae-9631-b8ef786f2526 tempest-VolumesGetTestJSON-1189122356 tempest-VolumesGetTestJSON-1189122356-project] Calling method '.version_select at 0x7f34f2e78d30>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:20:37.573392 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-6166f57d-91ac-43ae-9631-b8ef786f2526 tempest-VolumesGetTestJSON-1189122356 tempest-VolumesGetTestJSON-1189122356-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/f5e02104-a72f-4c3e-8804-82616124d5d6" status: 200 len: 354 microversion: 2.1 time: 0.228861 Oct 31 19:20:37.574618 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 2/3] 10.222.0.16 () {58 vars in 1245 bytes} [Mon Oct 31 19:20:37 2022] GET /compute/v2.1/os-volumes/f5e02104-a72f-4c3e-8804-82616124d5d6 => generated 354 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:20:37.588892 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-16258b19-36bf-4bac-8b83-4a85888acec0 tempest-VolumesGetTestJSON-1189122356 tempest-VolumesGetTestJSON-1189122356-project] Calling method '.version_select at 0x7f34f2ebbd30>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:20:38.401844 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-16258b19-36bf-4bac-8b83-4a85888acec0 tempest-VolumesGetTestJSON-1189122356 tempest-VolumesGetTestJSON-1189122356-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/f5e02104-a72f-4c3e-8804-82616124d5d6" status: 202 len: 0 microversion: 2.1 time: 0.817586 Oct 31 19:20:38.404509 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 2/4] 10.222.0.16 () {58 vars in 1248 bytes} [Mon Oct 31 19:20:37 2022] DELETE /compute/v2.1/os-volumes/f5e02104-a72f-4c3e-8804-82616124d5d6 => generated 0 bytes in 821 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 19:20:38.419611 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-b607ca96-681e-4cdc-9d93-fa4ae3a71759 tempest-VolumesGetTestJSON-1189122356 tempest-VolumesGetTestJSON-1189122356-project] Calling method '.version_select at 0x7f34f2e18430>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:20:38.737119 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-b607ca96-681e-4cdc-9d93-fa4ae3a71759 tempest-VolumesGetTestJSON-1189122356 tempest-VolumesGetTestJSON-1189122356-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/f5e02104-a72f-4c3e-8804-82616124d5d6" status: 200 len: 353 microversion: 2.1 time: 0.327151 Oct 31 19:20:38.738304 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 3/5] 10.222.0.16 () {58 vars in 1245 bytes} [Mon Oct 31 19:20:38 2022] GET /compute/v2.1/os-volumes/f5e02104-a72f-4c3e-8804-82616124d5d6 => generated 353 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:20:39.759424 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-2067f411-b52e-4e5d-a771-e5083af4a9c0 tempest-VolumesGetTestJSON-1189122356 tempest-VolumesGetTestJSON-1189122356-project] Calling method '.version_select at 0x7f34f2e7c430>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:20:39.850894 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.wsgi [None req-2067f411-b52e-4e5d-a771-e5083af4a9c0 tempest-VolumesGetTestJSON-1189122356 tempest-VolumesGetTestJSON-1189122356-project] HTTP exception thrown: Volume f5e02104-a72f-4c3e-8804-82616124d5d6 could not be found. Oct 31 19:20:39.856335 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-2067f411-b52e-4e5d-a771-e5083af4a9c0 tempest-VolumesGetTestJSON-1189122356 tempest-VolumesGetTestJSON-1189122356-project] Request method failure captured: Oct 31 19:20:39.856335 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: request: GET /compute/v2.1/os-volumes/f5e02104-a72f-4c3e-8804-82616124d5d6 HTTP/1.1 Oct 31 19:20:39.856335 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: Accept: application/json Oct 31 19:20:39.856335 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: Accept-Encoding: identity Oct 31 19:20:39.856335 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: Connection: close Oct 31 19:20:39.856335 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: Content-Length: 0 Oct 31 19:20:39.856335 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: Content-Type: application/json Oct 31 19:20:39.856335 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: Host: 10.222.0.16 Oct 31 19:20:39.856335 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: Openstack-System-Scope: None Oct 31 19:20:39.856335 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: User-Agent: python-urllib3/1.26.12 Oct 31 19:20:39.856335 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Auth-Token: gAAAAABjYCAACFMhYOHd6Mw0g6lU4y8MPWJuJUZoV9zaxJxylVwyKyzgz0b6jz4hPGeZbcAAfMvKnRUFiRP-ijVuBOKmCIPXU3Sdr4FuKpsaPRPkEQs50RGfFR-YVvtOLDfNLgJDzRTmNTTFT8CWwV6-bqfdSlxRG1kuNqmN92yN8z6AYhyaags Oct 31 19:20:39.856335 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Domain-Id: None Oct 31 19:20:39.856335 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Domain-Name: None Oct 31 19:20:39.856335 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Identity-Status: Confirmed Oct 31 19:20:39.856335 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Is-Admin-Project: True Oct 31 19:20:39.856335 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Project-Domain-Id: default Oct 31 19:20:39.856335 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Project-Domain-Name: Default Oct 31 19:20:39.856335 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Project-Id: 0bca698f6f454c23a4cef17898734fc2 Oct 31 19:20:39.856335 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Project-Name: tempest-VolumesGetTestJSON-1189122356 Oct 31 19:20:39.856335 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Role: member,reader Oct 31 19:20:39.856335 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Roles: member,reader Oct 31 19:20:39.857966 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0bca698f6f454c23a4cef17898734fc2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0bca698f6f454c23a4cef17898734fc2", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0bca698f6f454c23a4cef17898734fc2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0bca698f6f454c23a4cef17898734fc2"}]}] Oct 31 19:20:39.857966 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Tenant: tempest-VolumesGetTestJSON-1189122356 Oct 31 19:20:39.857966 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Tenant-Id: 0bca698f6f454c23a4cef17898734fc2 Oct 31 19:20:39.857966 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Tenant-Name: tempest-VolumesGetTestJSON-1189122356 Oct 31 19:20:39.857966 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-User: tempest-VolumesGetTestJSON-1189122356-project Oct 31 19:20:39.857966 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-User-Domain-Id: default Oct 31 19:20:39.857966 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-User-Domain-Name: Default Oct 31 19:20:39.857966 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-User-Id: c3586093425347b695a5240dda6f694f Oct 31 19:20:39.857966 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-User-Name: tempest-VolumesGetTestJSON-1189122356-project Oct 31 19:20:39.857966 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: method: Oct 31 19:20:39.857966 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: exception: Volume f5e02104-a72f-4c3e-8804-82616124d5d6 could not be found. Oct 31 19:20:39.857966 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: action_args: {'id': 'f5e02104-a72f-4c3e-8804-82616124d5d6'} Oct 31 19:20:39.857966 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 19:20:39.859216 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:20:39.859216 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 31 19:20:39.859216 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 31 19:20:39.859216 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 31 19:20:39.859216 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 31 19:20:39.859216 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 31 19:20:39.859216 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 31 19:20:39.859216 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 31 19:20:39.859216 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 31 19:20:39.859216 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 31 19:20:39.859216 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 31 19:20:39.859216 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 31 19:20:39.859216 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 31 19:20:39.859216 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 31 19:20:39.859216 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 31 19:20:39.859216 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f5e02104-a72f-4c3e-8804-82616124d5d6 could not be found. (HTTP 404) (Request-ID: req-cccc68b8-7c70-4d00-8866-41796b147f82) Oct 31 19:20:39.859216 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Oct 31 19:20:39.859216 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 19:20:39.859216 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Oct 31 19:20:39.860625 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:20:39.860625 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 31 19:20:39.860625 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 31 19:20:39.860625 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 31 19:20:39.860625 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 31 19:20:39.860625 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 31 19:20:39.860625 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 31 19:20:39.860625 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 31 19:20:39.860625 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 31 19:20:39.860625 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 31 19:20:39.860625 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 31 19:20:39.860625 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 31 19:20:39.860625 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 31 19:20:39.860625 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 31 19:20:39.860625 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 31 19:20:39.860625 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 31 19:20:39.860625 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 31 19:20:39.860625 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 31 19:20:39.860625 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 31 19:20:39.862014 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 31 19:20:39.862014 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 31 19:20:39.862014 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 31 19:20:39.862014 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 31 19:20:39.862014 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f5e02104-a72f-4c3e-8804-82616124d5d6 could not be found. Oct 31 19:20:39.862014 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Oct 31 19:20:39.862014 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 19:20:39.862014 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Oct 31 19:20:39.862014 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:20:39.862014 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 19:20:39.862014 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 19:20:39.862014 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 19:20:39.862014 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 19:20:39.862014 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 19:20:39.862014 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 19:20:39.862014 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 19:20:39.862014 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 19:20:39.862014 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 31 19:20:39.862014 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 19:20:39.863576 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f5e02104-a72f-4c3e-8804-82616124d5d6 could not be found. Oct 31 19:20:39.863576 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Oct 31 19:20:39.863576 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 19:20:39.863576 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Oct 31 19:20:39.863576 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:20:39.863576 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 19:20:39.863576 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 19:20:39.863576 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 19:20:39.863576 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 19:20:39.863576 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f5e02104-a72f-4c3e-8804-82616124d5d6 could not be found. Oct 31 19:20:39.863576 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Oct 31 19:20:39.863576 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-2067f411-b52e-4e5d-a771-e5083af4a9c0 tempest-VolumesGetTestJSON-1189122356 tempest-VolumesGetTestJSON-1189122356-project] Returning 404 to user: Volume f5e02104-a72f-4c3e-8804-82616124d5d6 could not be found. {{(pid=118726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 19:20:39.863576 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-2067f411-b52e-4e5d-a771-e5083af4a9c0 tempest-VolumesGetTestJSON-1189122356 tempest-VolumesGetTestJSON-1189122356-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/f5e02104-a72f-4c3e-8804-82616124d5d6" status: 404 len: 109 microversion: 2.1 time: 0.109913 Oct 31 19:20:39.863576 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 3/6] 10.222.0.16 () {58 vars in 1245 bytes} [Mon Oct 31 19:20:39 2022] GET /compute/v2.1/os-volumes/f5e02104-a72f-4c3e-8804-82616124d5d6 => generated 109 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 19:20:41.856430 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-8ffc7a91-5188-40d0-af83-5ddd52a30355 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Action: 'create', calling method: .version_select at 0x7f34f2e18a60>, body: {"keypair": {"name": "tempest-keypair-1084722088", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJlQQl9n6mD3X0fTS+h5LgivkwcI5J1wkoXXuxKi4xuaqvgtU0gav1eL+wLIxEfFTVqlkbYyrHI24bdDEpE158XLPi04qZH8pnmtBd3TfiVYDfm2d8jNEC8VOfO/eziY8Q=="}} {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:20:41.967764 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.quota [None req-8ffc7a91-5188-40d0-af83-5ddd52a30355 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Getting quotas for project 06b4e580885f431b9ccb8aa409fdd454. Resources: {'key_pairs'} {{(pid=118727) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 19:20:41.978423 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.quota [None req-8ffc7a91-5188-40d0-af83-5ddd52a30355 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Getting quotas for user 295bd78a5b204dc2a2d70a2610c6ab3e and project 06b4e580885f431b9ccb8aa409fdd454. Resources: {'key_pairs'} {{(pid=118727) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 19:20:42.085087 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-8ffc7a91-5188-40d0-af83-5ddd52a30355 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.506354 Oct 31 19:20:42.085888 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 4/7] 10.222.0.16 () {62 vars in 1200 bytes} [Mon Oct 31 19:20:41 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 508 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 31 19:20:44.523347 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-2c403d30-418d-44cc-9ad3-df5fdb329f37 tempest-VolumesNegativeTest-126455052 tempest-VolumesNegativeTest-126455052-project] Action: 'create', calling method: .version_select at 0x7f34f2de5430>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1224315399", "metadata": {"Type": "work"}}} {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:20:44.535322 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-2c403d30-418d-44cc-9ad3-df5fdb329f37 tempest-VolumesNegativeTest-126455052 tempest-VolumesNegativeTest-126455052-project] Request method failure captured: Oct 31 19:20:44.535322 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 31 19:20:44.535322 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: Accept: application/json Oct 31 19:20:44.535322 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: Accept-Encoding: identity Oct 31 19:20:44.535322 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: Connection: close Oct 31 19:20:44.535322 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: Content-Length: 122 Oct 31 19:20:44.535322 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: Content-Type: application/json Oct 31 19:20:44.535322 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: Host: 10.222.0.16 Oct 31 19:20:44.535322 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: Openstack-System-Scope: None Oct 31 19:20:44.535322 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: User-Agent: python-urllib3/1.26.12 Oct 31 19:20:44.535322 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Auth-Token: gAAAAABjYCAMiVT2BKFw7lyJeU3-qoXswXEaPqyemx5-s0y-hRZa2ci7gDozcSxK9EKIbIH-az_ykF9iNU9qIUELjnjeJDYOmpVDS9IIFaPKasSOegLO7Q-dAPe5bA8kAUcJNBTAvUfHsgJdKKoxziryKyd90-vgV3_Uk1O-9cssKBsb432Lum4 Oct 31 19:20:44.535322 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Domain-Id: None Oct 31 19:20:44.535322 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Domain-Name: None Oct 31 19:20:44.535322 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Identity-Status: Confirmed Oct 31 19:20:44.535322 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Is-Admin-Project: True Oct 31 19:20:44.535322 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Project-Domain-Id: default Oct 31 19:20:44.535322 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Project-Domain-Name: Default Oct 31 19:20:44.535322 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Project-Id: 2cb3953852e541f2ba511ffbcd37e766 Oct 31 19:20:44.535322 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Project-Name: tempest-VolumesNegativeTest-126455052 Oct 31 19:20:44.535322 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Role: member,reader Oct 31 19:20:44.535322 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Roles: member,reader Oct 31 19:20:44.536895 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2cb3953852e541f2ba511ffbcd37e766"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2cb3953852e541f2ba511ffbcd37e766", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2cb3953852e541f2ba511ffbcd37e766"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2cb3953852e541f2ba511ffbcd37e766"}]}] Oct 31 19:20:44.536895 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Tenant: tempest-VolumesNegativeTest-126455052 Oct 31 19:20:44.536895 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Tenant-Id: 2cb3953852e541f2ba511ffbcd37e766 Oct 31 19:20:44.536895 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Tenant-Name: tempest-VolumesNegativeTest-126455052 Oct 31 19:20:44.536895 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-User: tempest-VolumesNegativeTest-126455052-project Oct 31 19:20:44.536895 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-User-Domain-Id: default Oct 31 19:20:44.536895 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-User-Domain-Name: Default Oct 31 19:20:44.536895 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-User-Id: 02397d5842df45e5a633422f33af44f2 Oct 31 19:20:44.536895 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-User-Name: tempest-VolumesNegativeTest-126455052-project Oct 31 19:20:44.536895 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: Oct 31 19:20:44.536895 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1224315399", "metadata": {"Type": "work"}}} Oct 31 19:20:44.536895 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: method: Oct 31 19:20:44.536895 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 31 19:20:44.537992 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1224315399', 'metadata': {'Type': 'work'}}}} Oct 31 19:20:44.537992 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 19:20:44.537992 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:20:44.537992 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 31 19:20:44.537992 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 31 19:20:44.537992 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 31 19:20:44.537992 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi raise error Oct 31 19:20:44.537992 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Oct 31 19:20:44.537992 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Oct 31 19:20:44.537992 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 31 19:20:44.537992 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 31 19:20:44.537992 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Oct 31 19:20:44.537992 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 31 19:20:44.537992 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi '#$%' Oct 31 19:20:44.537992 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Oct 31 19:20:44.537992 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 19:20:44.537992 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Oct 31 19:20:44.537992 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:20:44.537992 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 19:20:44.537992 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 19:20:44.537992 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 19:20:44.537992 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 19:20:44.540430 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 19:20:44.540430 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 19:20:44.540430 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 19:20:44.540430 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 19:20:44.540430 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 31 19:20:44.540430 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 31 19:20:44.540430 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 31 19:20:44.540430 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 31 19:20:44.540430 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 31 19:20:44.540430 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 31 19:20:44.540430 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 31 19:20:44.540430 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Oct 31 19:20:44.540430 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 19:20:44.540430 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Oct 31 19:20:44.540430 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:20:44.540430 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 19:20:44.540430 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 19:20:44.540430 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 31 19:20:44.540430 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 31 19:20:44.543439 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 31 19:20:44.543439 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Oct 31 19:20:44.546059 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-2c403d30-418d-44cc-9ad3-df5fdb329f37 tempest-VolumesNegativeTest-126455052 tempest-VolumesNegativeTest-126455052-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=118726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 19:20:44.546922 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-2c403d30-418d-44cc-9ad3-df5fdb329f37 tempest-VolumesNegativeTest-126455052 tempest-VolumesNegativeTest-126455052-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.308324 Oct 31 19:20:44.555517 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 4/8] 10.222.0.16 () {60 vars in 1156 bytes} [Mon Oct 31 19:20:44 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 318 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 31 19:20:44.564740 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-0da36fb4-b3a6-4706-ba38-a57c74a68b70 tempest-VolumesNegativeTest-126455052 tempest-VolumesNegativeTest-126455052-project] Action: 'create', calling method: .version_select at 0x7f34f2df7af0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-305228730", "metadata": {"Type": "work"}}} {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:20:44.583959 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-0da36fb4-b3a6-4706-ba38-a57c74a68b70 tempest-VolumesNegativeTest-126455052 tempest-VolumesNegativeTest-126455052-project] Request method failure captured: Oct 31 19:20:44.583959 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 31 19:20:44.583959 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Accept: application/json Oct 31 19:20:44.583959 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Accept-Encoding: identity Oct 31 19:20:44.583959 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Connection: close Oct 31 19:20:44.583959 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Content-Length: 119 Oct 31 19:20:44.583959 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Content-Type: application/json Oct 31 19:20:44.583959 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Host: 10.222.0.16 Oct 31 19:20:44.583959 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Openstack-System-Scope: None Oct 31 19:20:44.583959 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: User-Agent: python-urllib3/1.26.12 Oct 31 19:20:44.583959 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Auth-Token: gAAAAABjYCAMiVT2BKFw7lyJeU3-qoXswXEaPqyemx5-s0y-hRZa2ci7gDozcSxK9EKIbIH-az_ykF9iNU9qIUELjnjeJDYOmpVDS9IIFaPKasSOegLO7Q-dAPe5bA8kAUcJNBTAvUfHsgJdKKoxziryKyd90-vgV3_Uk1O-9cssKBsb432Lum4 Oct 31 19:20:44.583959 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Domain-Id: None Oct 31 19:20:44.583959 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Domain-Name: None Oct 31 19:20:44.583959 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Identity-Status: Confirmed Oct 31 19:20:44.583959 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Is-Admin-Project: True Oct 31 19:20:44.583959 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Project-Domain-Id: default Oct 31 19:20:44.583959 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Project-Domain-Name: Default Oct 31 19:20:44.583959 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Project-Id: 2cb3953852e541f2ba511ffbcd37e766 Oct 31 19:20:44.583959 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Project-Name: tempest-VolumesNegativeTest-126455052 Oct 31 19:20:44.583959 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Role: member,reader Oct 31 19:20:44.583959 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Roles: member,reader Oct 31 19:20:44.585306 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2cb3953852e541f2ba511ffbcd37e766"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2cb3953852e541f2ba511ffbcd37e766", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2cb3953852e541f2ba511ffbcd37e766"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2cb3953852e541f2ba511ffbcd37e766"}]}] Oct 31 19:20:44.585306 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Tenant: tempest-VolumesNegativeTest-126455052 Oct 31 19:20:44.585306 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Tenant-Id: 2cb3953852e541f2ba511ffbcd37e766 Oct 31 19:20:44.585306 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Tenant-Name: tempest-VolumesNegativeTest-126455052 Oct 31 19:20:44.585306 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User: tempest-VolumesNegativeTest-126455052-project Oct 31 19:20:44.585306 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User-Domain-Id: default Oct 31 19:20:44.585306 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User-Domain-Name: Default Oct 31 19:20:44.585306 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User-Id: 02397d5842df45e5a633422f33af44f2 Oct 31 19:20:44.585306 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User-Name: tempest-VolumesNegativeTest-126455052-project Oct 31 19:20:44.585306 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Oct 31 19:20:44.585306 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-305228730", "metadata": {"Type": "work"}}} Oct 31 19:20:44.585306 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: method: Oct 31 19:20:44.585306 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 31 19:20:44.586398 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-305228730', 'metadata': {'Type': 'work'}}}} Oct 31 19:20:44.586398 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 19:20:44.586398 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:20:44.586398 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 31 19:20:44.586398 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 31 19:20:44.586398 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 31 19:20:44.586398 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi raise error Oct 31 19:20:44.586398 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 31 19:20:44.586398 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:20:44.586398 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Oct 31 19:20:44.586398 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 31 19:20:44.586398 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:20:44.586398 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 31 19:20:44.586398 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi '0' Oct 31 19:20:44.586398 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:20:44.586398 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 19:20:44.586398 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:20:44.586398 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:20:44.586398 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 19:20:44.586398 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 19:20:44.586398 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 19:20:44.586398 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 19:20:44.588239 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 19:20:44.588239 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 19:20:44.588239 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 19:20:44.588239 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 19:20:44.588239 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 31 19:20:44.588239 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 31 19:20:44.588239 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 31 19:20:44.588239 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 31 19:20:44.588239 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 31 19:20:44.588239 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 31 19:20:44.588239 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 31 19:20:44.588239 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:20:44.588239 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 19:20:44.588239 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:20:44.588239 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:20:44.588239 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 19:20:44.588239 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 19:20:44.588239 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 31 19:20:44.588239 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 31 19:20:44.589496 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 31 19:20:44.589496 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:20:44.589496 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-0da36fb4-b3a6-4706-ba38-a57c74a68b70 tempest-VolumesNegativeTest-126455052 tempest-VolumesNegativeTest-126455052-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=118727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 19:20:44.589496 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-0da36fb4-b3a6-4706-ba38-a57c74a68b70 tempest-VolumesNegativeTest-126455052 tempest-VolumesNegativeTest-126455052-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.024880 Oct 31 19:20:44.596145 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-e107f7dc-b49c-4e7d-9ca0-33e0c9804189 tempest-VolumesNegativeTest-126455052 tempest-VolumesNegativeTest-126455052-project] Action: 'create', calling method: .version_select at 0x7f34f2d9b430>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-90645334", "metadata": {"Type": "work"}}} {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:20:44.600663 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 5/9] 10.222.0.16 () {60 vars in 1156 bytes} [Mon Oct 31 19:20:44 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 40 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 31 19:20:44.603482 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-e107f7dc-b49c-4e7d-9ca0-33e0c9804189 tempest-VolumesNegativeTest-126455052 tempest-VolumesNegativeTest-126455052-project] Request method failure captured: Oct 31 19:20:44.603482 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 31 19:20:44.603482 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: Accept: application/json Oct 31 19:20:44.603482 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: Accept-Encoding: identity Oct 31 19:20:44.603482 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: Connection: close Oct 31 19:20:44.603482 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: Content-Length: 117 Oct 31 19:20:44.603482 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: Content-Type: application/json Oct 31 19:20:44.603482 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: Host: 10.222.0.16 Oct 31 19:20:44.603482 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: Openstack-System-Scope: None Oct 31 19:20:44.603482 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: User-Agent: python-urllib3/1.26.12 Oct 31 19:20:44.603482 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Auth-Token: gAAAAABjYCAMiVT2BKFw7lyJeU3-qoXswXEaPqyemx5-s0y-hRZa2ci7gDozcSxK9EKIbIH-az_ykF9iNU9qIUELjnjeJDYOmpVDS9IIFaPKasSOegLO7Q-dAPe5bA8kAUcJNBTAvUfHsgJdKKoxziryKyd90-vgV3_Uk1O-9cssKBsb432Lum4 Oct 31 19:20:44.603482 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Domain-Id: None Oct 31 19:20:44.603482 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Domain-Name: None Oct 31 19:20:44.603482 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Identity-Status: Confirmed Oct 31 19:20:44.603482 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Is-Admin-Project: True Oct 31 19:20:44.603482 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Project-Domain-Id: default Oct 31 19:20:44.603482 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Project-Domain-Name: Default Oct 31 19:20:44.603482 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Project-Id: 2cb3953852e541f2ba511ffbcd37e766 Oct 31 19:20:44.603482 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Project-Name: tempest-VolumesNegativeTest-126455052 Oct 31 19:20:44.603482 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Role: member,reader Oct 31 19:20:44.603482 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Roles: member,reader Oct 31 19:20:44.604778 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2cb3953852e541f2ba511ffbcd37e766"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2cb3953852e541f2ba511ffbcd37e766", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2cb3953852e541f2ba511ffbcd37e766"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2cb3953852e541f2ba511ffbcd37e766"}]}] Oct 31 19:20:44.604778 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Tenant: tempest-VolumesNegativeTest-126455052 Oct 31 19:20:44.604778 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Tenant-Id: 2cb3953852e541f2ba511ffbcd37e766 Oct 31 19:20:44.604778 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Tenant-Name: tempest-VolumesNegativeTest-126455052 Oct 31 19:20:44.604778 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-User: tempest-VolumesNegativeTest-126455052-project Oct 31 19:20:44.604778 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-User-Domain-Id: default Oct 31 19:20:44.604778 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-User-Domain-Name: Default Oct 31 19:20:44.604778 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-User-Id: 02397d5842df45e5a633422f33af44f2 Oct 31 19:20:44.604778 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-User-Name: tempest-VolumesNegativeTest-126455052-project Oct 31 19:20:44.604778 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: Oct 31 19:20:44.604778 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-90645334", "metadata": {"Type": "work"}}} Oct 31 19:20:44.604778 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: method: Oct 31 19:20:44.604778 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 31 19:20:44.605555 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-90645334', 'metadata': {'Type': 'work'}}}} Oct 31 19:20:44.605555 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 19:20:44.605555 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:20:44.605555 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 31 19:20:44.605555 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 31 19:20:44.605555 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 31 19:20:44.605555 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi raise error Oct 31 19:20:44.605555 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Oct 31 19:20:44.605555 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Oct 31 19:20:44.605555 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 31 19:20:44.605555 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 31 19:20:44.605555 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Oct 31 19:20:44.605555 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 31 19:20:44.605555 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi '' Oct 31 19:20:44.605555 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Oct 31 19:20:44.605555 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 19:20:44.605555 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Oct 31 19:20:44.605555 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:20:44.605555 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 19:20:44.605555 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 19:20:44.605555 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 19:20:44.605555 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 19:20:44.607821 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 19:20:44.607821 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 19:20:44.607821 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 19:20:44.607821 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 19:20:44.607821 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 31 19:20:44.607821 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 31 19:20:44.607821 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 31 19:20:44.607821 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 31 19:20:44.607821 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 31 19:20:44.607821 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 31 19:20:44.607821 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 31 19:20:44.607821 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Oct 31 19:20:44.607821 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 19:20:44.607821 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Oct 31 19:20:44.607821 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:20:44.607821 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 19:20:44.607821 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 19:20:44.607821 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 31 19:20:44.607821 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 31 19:20:44.608905 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 31 19:20:44.608905 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Oct 31 19:20:44.610354 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-e107f7dc-b49c-4e7d-9ca0-33e0c9804189 tempest-VolumesNegativeTest-126455052 tempest-VolumesNegativeTest-126455052-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=118726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 19:20:44.612523 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-e107f7dc-b49c-4e7d-9ca0-33e0c9804189 tempest-VolumesNegativeTest-126455052 tempest-VolumesNegativeTest-126455052-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.020747 Oct 31 19:20:44.622194 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 5/10] 10.222.0.16 () {60 vars in 1156 bytes} [Mon Oct 31 19:20:44 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 31 19:20:44.637264 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-a7b7929c-2319-4809-9c0e-afdecf2e67f3 tempest-VolumesNegativeTest-126455052 tempest-VolumesNegativeTest-126455052-project] Calling method '.version_select at 0x7f34f2fc3dc0>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:20:44.898165 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.wsgi [None req-a7b7929c-2319-4809-9c0e-afdecf2e67f3 tempest-VolumesNegativeTest-126455052 tempest-VolumesNegativeTest-126455052-project] HTTP exception thrown: Volume tempest-invalid-1335313917 could not be found. Oct 31 19:20:44.901753 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-a7b7929c-2319-4809-9c0e-afdecf2e67f3 tempest-VolumesNegativeTest-126455052 tempest-VolumesNegativeTest-126455052-project] Request method failure captured: Oct 31 19:20:44.901753 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1335313917 HTTP/1.1 Oct 31 19:20:44.901753 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Accept: application/json Oct 31 19:20:44.901753 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Accept-Encoding: identity Oct 31 19:20:44.901753 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Connection: close Oct 31 19:20:44.901753 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Content-Length: 0 Oct 31 19:20:44.901753 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Content-Type: application/json Oct 31 19:20:44.901753 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Host: 10.222.0.16 Oct 31 19:20:44.901753 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Openstack-System-Scope: None Oct 31 19:20:44.901753 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: User-Agent: python-urllib3/1.26.12 Oct 31 19:20:44.901753 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Auth-Token: gAAAAABjYCAMiVT2BKFw7lyJeU3-qoXswXEaPqyemx5-s0y-hRZa2ci7gDozcSxK9EKIbIH-az_ykF9iNU9qIUELjnjeJDYOmpVDS9IIFaPKasSOegLO7Q-dAPe5bA8kAUcJNBTAvUfHsgJdKKoxziryKyd90-vgV3_Uk1O-9cssKBsb432Lum4 Oct 31 19:20:44.901753 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Domain-Id: None Oct 31 19:20:44.901753 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Domain-Name: None Oct 31 19:20:44.901753 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Identity-Status: Confirmed Oct 31 19:20:44.901753 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Is-Admin-Project: True Oct 31 19:20:44.901753 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Project-Domain-Id: default Oct 31 19:20:44.901753 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Project-Domain-Name: Default Oct 31 19:20:44.901753 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Project-Id: 2cb3953852e541f2ba511ffbcd37e766 Oct 31 19:20:44.901753 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Project-Name: tempest-VolumesNegativeTest-126455052 Oct 31 19:20:44.901753 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Role: member,reader Oct 31 19:20:44.901753 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Roles: member,reader Oct 31 19:20:44.903331 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2cb3953852e541f2ba511ffbcd37e766"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2cb3953852e541f2ba511ffbcd37e766", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2cb3953852e541f2ba511ffbcd37e766"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2cb3953852e541f2ba511ffbcd37e766"}]}] Oct 31 19:20:44.903331 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Tenant: tempest-VolumesNegativeTest-126455052 Oct 31 19:20:44.903331 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Tenant-Id: 2cb3953852e541f2ba511ffbcd37e766 Oct 31 19:20:44.903331 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Tenant-Name: tempest-VolumesNegativeTest-126455052 Oct 31 19:20:44.903331 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User: tempest-VolumesNegativeTest-126455052-project Oct 31 19:20:44.903331 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User-Domain-Id: default Oct 31 19:20:44.903331 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User-Domain-Name: Default Oct 31 19:20:44.903331 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User-Id: 02397d5842df45e5a633422f33af44f2 Oct 31 19:20:44.903331 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User-Name: tempest-VolumesNegativeTest-126455052-project Oct 31 19:20:44.903331 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: method: Oct 31 19:20:44.903331 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: exception: Volume tempest-invalid-1335313917 could not be found. Oct 31 19:20:44.903331 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: action_args: {'id': 'tempest-invalid-1335313917'} Oct 31 19:20:44.903331 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 19:20:44.904358 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:20:44.904358 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 31 19:20:44.904358 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 31 19:20:44.904358 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 31 19:20:44.904358 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 31 19:20:44.904358 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 31 19:20:44.904358 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 31 19:20:44.904358 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 31 19:20:44.904358 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 31 19:20:44.904358 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 31 19:20:44.904358 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 31 19:20:44.904358 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 31 19:20:44.904358 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 31 19:20:44.904358 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 31 19:20:44.904358 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 31 19:20:44.904358 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1335313917 could not be found. (HTTP 404) (Request-ID: req-e8097000-8aea-4485-b60f-2e45cfbba852) Oct 31 19:20:44.904358 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:20:44.904358 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 19:20:44.904358 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:20:44.905748 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:20:44.905748 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 31 19:20:44.905748 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 31 19:20:44.905748 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 31 19:20:44.905748 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 31 19:20:44.905748 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 31 19:20:44.905748 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 31 19:20:44.905748 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 31 19:20:44.905748 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 31 19:20:44.905748 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 31 19:20:44.905748 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 31 19:20:44.905748 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 31 19:20:44.905748 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 31 19:20:44.905748 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 31 19:20:44.905748 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 31 19:20:44.905748 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 31 19:20:44.905748 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 31 19:20:44.905748 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 31 19:20:44.905748 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 31 19:20:44.907078 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 31 19:20:44.907078 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 31 19:20:44.907078 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 31 19:20:44.907078 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 31 19:20:44.907078 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1335313917 could not be found. Oct 31 19:20:44.907078 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:20:44.907078 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 19:20:44.907078 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:20:44.907078 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:20:44.907078 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 19:20:44.907078 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 19:20:44.907078 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 19:20:44.907078 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 19:20:44.907078 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 19:20:44.907078 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 19:20:44.907078 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 19:20:44.907078 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 19:20:44.907078 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 31 19:20:44.907078 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 19:20:44.907078 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1335313917 could not be found. Oct 31 19:20:44.908501 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:20:44.908501 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 19:20:44.908501 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:20:44.908501 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:20:44.908501 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 19:20:44.908501 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 19:20:44.908501 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 19:20:44.908501 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 19:20:44.908501 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1335313917 could not be found. Oct 31 19:20:44.908501 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:20:44.908501 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-a7b7929c-2319-4809-9c0e-afdecf2e67f3 tempest-VolumesNegativeTest-126455052 tempest-VolumesNegativeTest-126455052-project] Returning 404 to user: Volume tempest-invalid-1335313917 could not be found. {{(pid=118727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 19:20:44.908501 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-a7b7929c-2319-4809-9c0e-afdecf2e67f3 tempest-VolumesNegativeTest-126455052 tempest-VolumesNegativeTest-126455052-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1335313917" status: 404 len: 99 microversion: 2.1 time: 0.273667 Oct 31 19:20:44.908501 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 6/11] 10.222.0.16 () {58 vars in 1218 bytes} [Mon Oct 31 19:20:44 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1335313917 => generated 99 bytes in 275 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 31 19:20:44.919681 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-ec08041b-ee76-4e36-8b22-51fefbc69ace tempest-VolumesNegativeTest-126455052 tempest-VolumesNegativeTest-126455052-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005265 Oct 31 19:20:44.920383 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 6/12] 10.222.0.16 () {58 vars in 1140 bytes} [Mon Oct 31 19:20:44 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 31 19:20:44.930942 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-13d501a9-c3ed-43c7-925a-6fb81000f19b tempest-VolumesNegativeTest-126455052 tempest-VolumesNegativeTest-126455052-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004931 Oct 31 19:20:44.931973 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 7/13] 10.222.0.16 () {58 vars in 1137 bytes} [Mon Oct 31 19:20:44 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 31 19:20:44.941015 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-5b90b987-4d02-4d83-933a-92a1236481cf tempest-VolumesNegativeTest-126455052 tempest-VolumesNegativeTest-126455052-project] Calling method '.version_select at 0x7f34f2da9310>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:20:45.083193 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.wsgi [None req-5b90b987-4d02-4d83-933a-92a1236481cf tempest-VolumesNegativeTest-126455052 tempest-VolumesNegativeTest-126455052-project] HTTP exception thrown: Volume 4735f4bb-9e22-4161-9a7a-67d4dba5aa1d could not be found. Oct 31 19:20:45.086067 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-5b90b987-4d02-4d83-933a-92a1236481cf tempest-VolumesNegativeTest-126455052 tempest-VolumesNegativeTest-126455052-project] Request method failure captured: Oct 31 19:20:45.086067 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: request: DELETE /compute/v2.1/os-volumes/4735f4bb-9e22-4161-9a7a-67d4dba5aa1d HTTP/1.1 Oct 31 19:20:45.086067 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: Accept: application/json Oct 31 19:20:45.086067 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: Accept-Encoding: identity Oct 31 19:20:45.086067 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: Connection: close Oct 31 19:20:45.086067 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: Content-Length: 0 Oct 31 19:20:45.086067 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: Content-Type: application/json Oct 31 19:20:45.086067 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: Host: 10.222.0.16 Oct 31 19:20:45.086067 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: Openstack-System-Scope: None Oct 31 19:20:45.086067 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: User-Agent: python-urllib3/1.26.12 Oct 31 19:20:45.086067 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Auth-Token: gAAAAABjYCAMiVT2BKFw7lyJeU3-qoXswXEaPqyemx5-s0y-hRZa2ci7gDozcSxK9EKIbIH-az_ykF9iNU9qIUELjnjeJDYOmpVDS9IIFaPKasSOegLO7Q-dAPe5bA8kAUcJNBTAvUfHsgJdKKoxziryKyd90-vgV3_Uk1O-9cssKBsb432Lum4 Oct 31 19:20:45.086067 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Domain-Id: None Oct 31 19:20:45.086067 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Domain-Name: None Oct 31 19:20:45.086067 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Identity-Status: Confirmed Oct 31 19:20:45.086067 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Is-Admin-Project: True Oct 31 19:20:45.086067 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Project-Domain-Id: default Oct 31 19:20:45.086067 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Project-Domain-Name: Default Oct 31 19:20:45.086067 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Project-Id: 2cb3953852e541f2ba511ffbcd37e766 Oct 31 19:20:45.086067 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Project-Name: tempest-VolumesNegativeTest-126455052 Oct 31 19:20:45.086067 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Role: member,reader Oct 31 19:20:45.086067 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Roles: member,reader Oct 31 19:20:45.087380 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2cb3953852e541f2ba511ffbcd37e766"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2cb3953852e541f2ba511ffbcd37e766", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2cb3953852e541f2ba511ffbcd37e766"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2cb3953852e541f2ba511ffbcd37e766"}]}] Oct 31 19:20:45.087380 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Tenant: tempest-VolumesNegativeTest-126455052 Oct 31 19:20:45.087380 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Tenant-Id: 2cb3953852e541f2ba511ffbcd37e766 Oct 31 19:20:45.087380 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Tenant-Name: tempest-VolumesNegativeTest-126455052 Oct 31 19:20:45.087380 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-User: tempest-VolumesNegativeTest-126455052-project Oct 31 19:20:45.087380 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-User-Domain-Id: default Oct 31 19:20:45.087380 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-User-Domain-Name: Default Oct 31 19:20:45.087380 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-User-Id: 02397d5842df45e5a633422f33af44f2 Oct 31 19:20:45.087380 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-User-Name: tempest-VolumesNegativeTest-126455052-project Oct 31 19:20:45.087380 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: method: Oct 31 19:20:45.087380 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: exception: Volume 4735f4bb-9e22-4161-9a7a-67d4dba5aa1d could not be found. Oct 31 19:20:45.087380 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: action_args: {'id': '4735f4bb-9e22-4161-9a7a-67d4dba5aa1d'} Oct 31 19:20:45.087380 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 19:20:45.088145 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:20:45.088145 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 31 19:20:45.088145 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 31 19:20:45.088145 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 31 19:20:45.088145 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 31 19:20:45.088145 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 31 19:20:45.088145 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 31 19:20:45.088145 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 31 19:20:45.088145 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 31 19:20:45.088145 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 31 19:20:45.088145 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 31 19:20:45.088145 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 31 19:20:45.088145 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 31 19:20:45.088145 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 31 19:20:45.088145 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 31 19:20:45.088145 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4735f4bb-9e22-4161-9a7a-67d4dba5aa1d could not be found. (HTTP 404) (Request-ID: req-4fe46ec9-4266-4958-81b1-e3859b9f04ab) Oct 31 19:20:45.088145 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Oct 31 19:20:45.088145 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 19:20:45.088145 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Oct 31 19:20:45.089508 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:20:45.089508 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 31 19:20:45.089508 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 31 19:20:45.089508 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 31 19:20:45.089508 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 31 19:20:45.089508 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 31 19:20:45.089508 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 31 19:20:45.089508 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 31 19:20:45.089508 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 31 19:20:45.089508 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 31 19:20:45.089508 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 31 19:20:45.089508 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 31 19:20:45.089508 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 31 19:20:45.089508 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 31 19:20:45.089508 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 31 19:20:45.089508 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 31 19:20:45.089508 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 31 19:20:45.089508 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 31 19:20:45.089508 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 31 19:20:45.093720 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 31 19:20:45.093720 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 31 19:20:45.093720 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 31 19:20:45.093720 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 31 19:20:45.093720 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4735f4bb-9e22-4161-9a7a-67d4dba5aa1d could not be found. Oct 31 19:20:45.093720 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Oct 31 19:20:45.093720 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 19:20:45.093720 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Oct 31 19:20:45.093720 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:20:45.093720 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 19:20:45.093720 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 19:20:45.093720 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 19:20:45.093720 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 19:20:45.093720 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 19:20:45.093720 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 19:20:45.093720 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 19:20:45.093720 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 19:20:45.093720 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 31 19:20:45.093720 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 19:20:45.097299 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4735f4bb-9e22-4161-9a7a-67d4dba5aa1d could not be found. Oct 31 19:20:45.097299 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Oct 31 19:20:45.097299 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 19:20:45.097299 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Oct 31 19:20:45.097299 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:20:45.097299 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 19:20:45.097299 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 19:20:45.097299 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 19:20:45.097299 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 19:20:45.097299 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4735f4bb-9e22-4161-9a7a-67d4dba5aa1d could not be found. Oct 31 19:20:45.097299 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Oct 31 19:20:45.100334 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-5b90b987-4d02-4d83-933a-92a1236481cf tempest-VolumesNegativeTest-126455052 tempest-VolumesNegativeTest-126455052-project] Returning 404 to user: Volume 4735f4bb-9e22-4161-9a7a-67d4dba5aa1d could not be found. {{(pid=118726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 19:20:45.101132 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-5b90b987-4d02-4d83-933a-92a1236481cf tempest-VolumesNegativeTest-126455052 tempest-VolumesNegativeTest-126455052-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/4735f4bb-9e22-4161-9a7a-67d4dba5aa1d" status: 404 len: 109 microversion: 2.1 time: 0.163852 Oct 31 19:20:45.102936 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 7/14] 10.222.0.16 () {58 vars in 1248 bytes} [Mon Oct 31 19:20:44 2022] DELETE /compute/v2.1/os-volumes/4735f4bb-9e22-4161-9a7a-67d4dba5aa1d => generated 109 bytes in 166 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 19:20:45.112231 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-5a2b0b5c-2043-412e-af64-51888c90fad4 tempest-VolumesNegativeTest-126455052 tempest-VolumesNegativeTest-126455052-project] Calling method '.version_select at 0x7f34f2e18f70>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:20:45.215615 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.wsgi [None req-5a2b0b5c-2043-412e-af64-51888c90fad4 tempest-VolumesNegativeTest-126455052 tempest-VolumesNegativeTest-126455052-project] HTTP exception thrown: Volume d3baa65e-3339-45c1-b055-d024ec9a42de could not be found. Oct 31 19:20:45.218831 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-5a2b0b5c-2043-412e-af64-51888c90fad4 tempest-VolumesNegativeTest-126455052 tempest-VolumesNegativeTest-126455052-project] Request method failure captured: Oct 31 19:20:45.218831 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: request: GET /compute/v2.1/os-volumes/d3baa65e-3339-45c1-b055-d024ec9a42de HTTP/1.1 Oct 31 19:20:45.218831 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Accept: application/json Oct 31 19:20:45.218831 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Accept-Encoding: identity Oct 31 19:20:45.218831 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Connection: close Oct 31 19:20:45.218831 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Content-Length: 0 Oct 31 19:20:45.218831 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Content-Type: application/json Oct 31 19:20:45.218831 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Host: 10.222.0.16 Oct 31 19:20:45.218831 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Openstack-System-Scope: None Oct 31 19:20:45.218831 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: User-Agent: python-urllib3/1.26.12 Oct 31 19:20:45.218831 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Auth-Token: gAAAAABjYCAMiVT2BKFw7lyJeU3-qoXswXEaPqyemx5-s0y-hRZa2ci7gDozcSxK9EKIbIH-az_ykF9iNU9qIUELjnjeJDYOmpVDS9IIFaPKasSOegLO7Q-dAPe5bA8kAUcJNBTAvUfHsgJdKKoxziryKyd90-vgV3_Uk1O-9cssKBsb432Lum4 Oct 31 19:20:45.218831 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Domain-Id: None Oct 31 19:20:45.218831 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Domain-Name: None Oct 31 19:20:45.218831 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Identity-Status: Confirmed Oct 31 19:20:45.218831 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Is-Admin-Project: True Oct 31 19:20:45.218831 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Project-Domain-Id: default Oct 31 19:20:45.218831 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Project-Domain-Name: Default Oct 31 19:20:45.218831 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Project-Id: 2cb3953852e541f2ba511ffbcd37e766 Oct 31 19:20:45.218831 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Project-Name: tempest-VolumesNegativeTest-126455052 Oct 31 19:20:45.218831 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Role: member,reader Oct 31 19:20:45.218831 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Roles: member,reader Oct 31 19:20:45.221754 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2cb3953852e541f2ba511ffbcd37e766"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2cb3953852e541f2ba511ffbcd37e766", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2cb3953852e541f2ba511ffbcd37e766"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2cb3953852e541f2ba511ffbcd37e766"}]}] Oct 31 19:20:45.221754 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Tenant: tempest-VolumesNegativeTest-126455052 Oct 31 19:20:45.221754 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Tenant-Id: 2cb3953852e541f2ba511ffbcd37e766 Oct 31 19:20:45.221754 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Tenant-Name: tempest-VolumesNegativeTest-126455052 Oct 31 19:20:45.221754 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User: tempest-VolumesNegativeTest-126455052-project Oct 31 19:20:45.221754 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User-Domain-Id: default Oct 31 19:20:45.221754 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User-Domain-Name: Default Oct 31 19:20:45.221754 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User-Id: 02397d5842df45e5a633422f33af44f2 Oct 31 19:20:45.221754 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User-Name: tempest-VolumesNegativeTest-126455052-project Oct 31 19:20:45.221754 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: method: Oct 31 19:20:45.221754 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: exception: Volume d3baa65e-3339-45c1-b055-d024ec9a42de could not be found. Oct 31 19:20:45.221754 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: action_args: {'id': 'd3baa65e-3339-45c1-b055-d024ec9a42de'} Oct 31 19:20:45.221754 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 19:20:45.222524 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:20:45.222524 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 31 19:20:45.222524 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 31 19:20:45.222524 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 31 19:20:45.222524 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 31 19:20:45.222524 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 31 19:20:45.222524 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 31 19:20:45.222524 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 31 19:20:45.222524 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 31 19:20:45.222524 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 31 19:20:45.222524 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 31 19:20:45.222524 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 31 19:20:45.222524 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 31 19:20:45.222524 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 31 19:20:45.222524 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 31 19:20:45.222524 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d3baa65e-3339-45c1-b055-d024ec9a42de could not be found. (HTTP 404) (Request-ID: req-b7160e8e-ef28-4cb2-af87-3175a541dc61) Oct 31 19:20:45.222524 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:20:45.222524 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 19:20:45.222524 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:20:45.225041 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:20:45.225041 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 31 19:20:45.225041 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 31 19:20:45.225041 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 31 19:20:45.225041 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 31 19:20:45.225041 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 31 19:20:45.225041 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 31 19:20:45.225041 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 31 19:20:45.225041 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 31 19:20:45.225041 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 31 19:20:45.225041 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 31 19:20:45.225041 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 31 19:20:45.225041 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 31 19:20:45.225041 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 31 19:20:45.225041 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 31 19:20:45.225041 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 31 19:20:45.225041 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 31 19:20:45.225041 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 31 19:20:45.225041 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 31 19:20:45.226162 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 31 19:20:45.226162 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 31 19:20:45.226162 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 31 19:20:45.226162 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 31 19:20:45.226162 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d3baa65e-3339-45c1-b055-d024ec9a42de could not be found. Oct 31 19:20:45.226162 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:20:45.226162 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 19:20:45.226162 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:20:45.226162 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:20:45.226162 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 19:20:45.226162 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 19:20:45.226162 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 19:20:45.226162 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 19:20:45.226162 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 19:20:45.226162 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 19:20:45.226162 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 19:20:45.226162 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 19:20:45.226162 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 31 19:20:45.226162 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 19:20:45.227326 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d3baa65e-3339-45c1-b055-d024ec9a42de could not be found. Oct 31 19:20:45.227326 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:20:45.227326 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 19:20:45.227326 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:20:45.227326 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:20:45.227326 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 19:20:45.227326 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 19:20:45.227326 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 19:20:45.227326 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 19:20:45.227326 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d3baa65e-3339-45c1-b055-d024ec9a42de could not be found. Oct 31 19:20:45.227326 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:20:45.227326 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-5a2b0b5c-2043-412e-af64-51888c90fad4 tempest-VolumesNegativeTest-126455052 tempest-VolumesNegativeTest-126455052-project] Returning 404 to user: Volume d3baa65e-3339-45c1-b055-d024ec9a42de could not be found. {{(pid=118727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 19:20:45.227326 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-5a2b0b5c-2043-412e-af64-51888c90fad4 tempest-VolumesNegativeTest-126455052 tempest-VolumesNegativeTest-126455052-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/d3baa65e-3339-45c1-b055-d024ec9a42de" status: 404 len: 109 microversion: 2.1 time: 0.113765 Oct 31 19:20:45.233286 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 8/15] 10.222.0.16 () {58 vars in 1245 bytes} [Mon Oct 31 19:20:45 2022] GET /compute/v2.1/os-volumes/d3baa65e-3339-45c1-b055-d024ec9a42de => generated 109 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 19:20:47.485091 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-ad81c467-f164-49dc-a71a-699f3ff4aa2e tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-456475546", "imageRef": "a9795ee0-6722-4e1e-8fc8-a6c2e68f3049", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fc617f6e-5991-4f0c-a83c-e8b4b519bfd4"}], "security_groups": [{"name": "tempest-securitygroup--1288442823"}], "key_name": "tempest-keypair-1084722088", "user_data": "}} {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:20:47.990643 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.network.neutron [None req-ad81c467-f164-49dc-a71a-699f3ff4aa2e tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] validate_networks() for [('fc617f6e-5991-4f0c-a83c-e8b4b519bfd4', None, None, None, None, None)] {{(pid=118726) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 19:20:49.621291 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-05839115-483e-4087-976f-3bd9fccd5eea tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-299423519", "imageRef": "a9795ee0-6722-4e1e-8fc8-a6c2e68f3049", "flavorRef": "452", "networks": [{"uuid": "63593bdb-a055-4a28-947d-cfc60fc8843a"}]}} {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:20:49.830812 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.network.neutron [None req-05839115-483e-4087-976f-3bd9fccd5eea tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] validate_networks() for [('63593bdb-a055-4a28-947d-cfc60fc8843a', None, None, None, None, None)] {{(pid=118727) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 19:20:51.938482 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.virt.hardware [None req-ad81c467-f164-49dc-a71a-699f3ff4aa2e tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Flavor limits 0:0:0 {{(pid=118726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 19:20:51.941278 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.virt.hardware [None req-ad81c467-f164-49dc-a71a-699f3ff4aa2e tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Image limits 0:0:0 {{(pid=118726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 19:20:51.942048 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.virt.hardware [None req-ad81c467-f164-49dc-a71a-699f3ff4aa2e tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Flavor pref 0:0:0 {{(pid=118726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 19:20:51.942588 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.virt.hardware [None req-ad81c467-f164-49dc-a71a-699f3ff4aa2e tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Image pref 0:0:0 {{(pid=118726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 19:20:51.944004 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.virt.hardware [None req-ad81c467-f164-49dc-a71a-699f3ff4aa2e tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 19:20:51.982442 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-ad81c467-f164-49dc-a71a-699f3ff4aa2e tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:20:51.985118 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-ad81c467-f164-49dc-a71a-699f3ff4aa2e tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:20:51.985633 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-ad81c467-f164-49dc-a71a-699f3ff4aa2e tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:20:51.986389 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-ad81c467-f164-49dc-a71a-699f3ff4aa2e tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:20:51.993477 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-ad81c467-f164-49dc-a71a-699f3ff4aa2e tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:20:51.994113 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-ad81c467-f164-49dc-a71a-699f3ff4aa2e tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:20:51.999255 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG dbcounter [-] [118727] Writing DB stats nova_cell0:SELECT=4 {{(pid=118727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:20:52.087561 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.quota [None req-ad81c467-f164-49dc-a71a-699f3ff4aa2e tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Getting quotas for project 06b4e580885f431b9ccb8aa409fdd454. Resources: {'instances', 'ram', 'cores'} {{(pid=118726) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 19:20:52.116659 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.quota [None req-ad81c467-f164-49dc-a71a-699f3ff4aa2e tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Getting quotas for user 295bd78a5b204dc2a2d70a2610c6ab3e and project 06b4e580885f431b9ccb8aa409fdd454. Resources: {'instances', 'ram', 'cores'} {{(pid=118726) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 19:20:52.173464 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-ad81c467-f164-49dc-a71a-699f3ff4aa2e tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Going to run 1 instances... {{(pid=118726) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 19:20:52.188675 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-ad81c467-f164-49dc-a71a-699f3ff4aa2e tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 24ad6e3e-6043-4eff-afb4-0c6039e825fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9795ee0-6722-4e1e-8fc8-a6c2e68f3049',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118726) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 19:20:52.342700 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.virt.hardware [None req-05839115-483e-4087-976f-3bd9fccd5eea tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Flavor limits 0:0:0 {{(pid=118727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 19:20:52.343294 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.virt.hardware [None req-05839115-483e-4087-976f-3bd9fccd5eea tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Image limits 0:0:0 {{(pid=118727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 19:20:52.343908 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.virt.hardware [None req-05839115-483e-4087-976f-3bd9fccd5eea tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Flavor pref 0:0:0 {{(pid=118727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 19:20:52.344457 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.virt.hardware [None req-05839115-483e-4087-976f-3bd9fccd5eea tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Image pref 0:0:0 {{(pid=118727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 19:20:52.345432 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.virt.hardware [None req-05839115-483e-4087-976f-3bd9fccd5eea tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 19:20:52.406629 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-05839115-483e-4087-976f-3bd9fccd5eea tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:20:52.409458 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-05839115-483e-4087-976f-3bd9fccd5eea tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:20:52.410423 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-05839115-483e-4087-976f-3bd9fccd5eea tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:20:52.414135 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-05839115-483e-4087-976f-3bd9fccd5eea tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:20:52.414832 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-05839115-483e-4087-976f-3bd9fccd5eea tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:20:52.415519 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-05839115-483e-4087-976f-3bd9fccd5eea tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:20:52.499587 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-ad81c467-f164-49dc-a71a-699f3ff4aa2e tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 5.022080 Oct 31 19:20:52.507282 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.quota [None req-05839115-483e-4087-976f-3bd9fccd5eea tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Getting quotas for project 4c549a25d33441e98aae78e940a69c7c. Resources: {'instances', 'ram', 'cores'} {{(pid=118727) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 19:20:52.514403 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 8/16] 10.222.0.16 () {62 vars in 1188 bytes} [Mon Oct 31 19:20:47 2022] POST /compute/v2.1/servers => generated 402 bytes in 5037 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 31 19:20:52.519352 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.quota [None req-05839115-483e-4087-976f-3bd9fccd5eea tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Getting quotas for user af27927be0e249bfb320652152f501bc and project 4c549a25d33441e98aae78e940a69c7c. Resources: {'instances', 'ram', 'cores'} {{(pid=118727) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 19:20:52.550104 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-6b357688-38f4-40c4-9a0f-606d12589af8 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:20:52.554179 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-6b357688-38f4-40c4-9a0f-606d12589af8 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 24ad6e3e-6043-4eff-afb4-0c6039e825fa] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:20:52.554917 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-05839115-483e-4087-976f-3bd9fccd5eea tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Going to run 1 instances... {{(pid=118727) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 19:20:52.560833 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-05839115-483e-4087-976f-3bd9fccd5eea tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] [instance: 98a9a544-4553-4083-aa26-1dc327369d54] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9795ee0-6722-4e1e-8fc8-a6c2e68f3049',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118727) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 19:20:52.824027 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-05839115-483e-4087-976f-3bd9fccd5eea tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.635628 Oct 31 19:20:52.826207 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 9/17] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 31 19:20:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 3638 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 19:20:52.843204 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-af064665-97f0-4911-ba4c-bfdd9515eebd tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:20:52.848303 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-af064665-97f0-4911-ba4c-bfdd9515eebd tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] [instance: 98a9a544-4553-4083-aa26-1dc327369d54] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:20:52.913715 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-6b357688-38f4-40c4-9a0f-606d12589af8 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:20:52.962701 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-6b357688-38f4-40c4-9a0f-606d12589af8 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:20:52.967468 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-6b357688-38f4-40c4-9a0f-606d12589af8 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:20:52.968630 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-6b357688-38f4-40c4-9a0f-606d12589af8 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa" status: 200 len: 1281 microversion: 2.20 time: 0.450080 Oct 31 19:20:52.969188 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 9/18] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 31 19:20:52 2022] GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa => generated 1281 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 19:20:53.122013 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-af064665-97f0-4911-ba4c-bfdd9515eebd tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af27927be0e249bfb320652152f501bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c549a25d33441e98aae78e940a69c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:20:53.164035 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-af064665-97f0-4911-ba4c-bfdd9515eebd tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] 10.222.0.16 "GET /compute/v2.1/servers/98a9a544-4553-4083-aa26-1dc327369d54" status: 200 len: 1214 microversion: 2.1 time: 0.326183 Oct 31 19:20:53.165779 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 10/19] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:20:52 2022] GET /compute/v2.1/servers/98a9a544-4553-4083-aa26-1dc327369d54 => generated 1214 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:20:53.768930 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-efe6d147-8e4b-4b64-a6d9-0e2cfb6faa11 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-798934921", "imageRef": "a9795ee0-6722-4e1e-8fc8-a6c2e68f3049", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:20:53.899151 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.network.neutron [None req-efe6d147-8e4b-4b64-a6d9-0e2cfb6faa11 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] validate_networks() for [('76d0a169-b981-4155-bbd7-0bbdbbf23238', None, None, None, None, None)] {{(pid=118726) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 19:20:53.970903 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-95fb8546-2dc1-47e4-a107-d050bce3a1ed tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Action: 'create', calling method: .version_select at 0x7f34f2c66f70>, body: {"keypair": {"name": "tempest-keypair-656109420", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHZ8TcvQNRTDaEgzFojp6oT/Z4bK/H7PGz+SkRqgmf3F+QneaAhjM8P3ERq6yfkHXyvVB0EOjTmG9q6JSRS/g/nK9+Jdpld7Z4dXT5EgytoOwgB5PecatEv17mW+AnMNDA=="}} {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:20:54.028648 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.quota [None req-95fb8546-2dc1-47e4-a107-d050bce3a1ed tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Getting quotas for project 3f9c317b548b40deb8cb27236d36d674. Resources: {'key_pairs'} {{(pid=118727) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 19:20:54.045515 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.quota [None req-95fb8546-2dc1-47e4-a107-d050bce3a1ed tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Getting quotas for user ece6ca9374764214bac6263bd691bc4d and project 3f9c317b548b40deb8cb27236d36d674. Resources: {'key_pairs'} {{(pid=118727) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 19:20:54.122571 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-95fb8546-2dc1-47e4-a107-d050bce3a1ed tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.954803 Oct 31 19:20:54.123174 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 11/20] 10.222.0.16 () {60 vars in 1159 bytes} [Mon Oct 31 19:20:53 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:20:54.131518 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-2bc13acf-c9cf-458b-901e-26fe5c74b6f0 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:20:54.132540 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-2bc13acf-c9cf-458b-901e-26fe5c74b6f0 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 24ad6e3e-6043-4eff-afb4-0c6039e825fa] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:20:54.283538 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-2bc13acf-c9cf-458b-901e-26fe5c74b6f0 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:20:54.298235 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-2bc13acf-c9cf-458b-901e-26fe5c74b6f0 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:20:54.305023 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-2bc13acf-c9cf-458b-901e-26fe5c74b6f0 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:20:54.306966 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-2bc13acf-c9cf-458b-901e-26fe5c74b6f0 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa" status: 200 len: 1281 microversion: 2.20 time: 0.181277 Oct 31 19:20:54.309521 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 12/21] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 31 19:20:54 2022] GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa => generated 1281 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 19:20:54.325500 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-66380896-9206-47d2-9a4a-91564b5e6958 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:20:54.327680 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-66380896-9206-47d2-9a4a-91564b5e6958 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] [instance: 98a9a544-4553-4083-aa26-1dc327369d54] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:20:54.565527 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-66380896-9206-47d2-9a4a-91564b5e6958 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af27927be0e249bfb320652152f501bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c549a25d33441e98aae78e940a69c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:20:54.582675 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-66380896-9206-47d2-9a4a-91564b5e6958 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] 10.222.0.16 "GET /compute/v2.1/servers/98a9a544-4553-4083-aa26-1dc327369d54" status: 200 len: 1214 microversion: 2.1 time: 0.262803 Oct 31 19:20:54.586727 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 13/22] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:20:54 2022] GET /compute/v2.1/servers/98a9a544-4553-4083-aa26-1dc327369d54 => generated 1214 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:20:54.944641 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.virt.hardware [None req-efe6d147-8e4b-4b64-a6d9-0e2cfb6faa11 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Flavor limits 0:0:0 {{(pid=118726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 19:20:54.945552 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.virt.hardware [None req-efe6d147-8e4b-4b64-a6d9-0e2cfb6faa11 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Image limits 0:0:0 {{(pid=118726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 19:20:54.946221 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.virt.hardware [None req-efe6d147-8e4b-4b64-a6d9-0e2cfb6faa11 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Flavor pref 0:0:0 {{(pid=118726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 19:20:54.947046 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.virt.hardware [None req-efe6d147-8e4b-4b64-a6d9-0e2cfb6faa11 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Image pref 0:0:0 {{(pid=118726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 19:20:54.947730 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.virt.hardware [None req-efe6d147-8e4b-4b64-a6d9-0e2cfb6faa11 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 19:20:54.962555 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-efe6d147-8e4b-4b64-a6d9-0e2cfb6faa11 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:20:54.963825 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-efe6d147-8e4b-4b64-a6d9-0e2cfb6faa11 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:20:54.964411 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-efe6d147-8e4b-4b64-a6d9-0e2cfb6faa11 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:20:54.965281 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-efe6d147-8e4b-4b64-a6d9-0e2cfb6faa11 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:20:54.965960 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-efe6d147-8e4b-4b64-a6d9-0e2cfb6faa11 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:20:54.966553 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-efe6d147-8e4b-4b64-a6d9-0e2cfb6faa11 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:20:54.986300 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.quota [None req-efe6d147-8e4b-4b64-a6d9-0e2cfb6faa11 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Getting quotas for project 73cf63c76fc543428404002ae9a75b29. Resources: {'instances', 'ram', 'cores'} {{(pid=118726) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 19:20:54.991372 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.quota [None req-efe6d147-8e4b-4b64-a6d9-0e2cfb6faa11 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Getting quotas for user ddc49f9eb3114759b2889ed8972136d8 and project 73cf63c76fc543428404002ae9a75b29. Resources: {'instances', 'ram', 'cores'} {{(pid=118726) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 19:20:55.004515 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-efe6d147-8e4b-4b64-a6d9-0e2cfb6faa11 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Going to run 1 instances... {{(pid=118726) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 19:20:55.007407 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-efe6d147-8e4b-4b64-a6d9-0e2cfb6faa11 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 7a47cd33-e4a0-4b78-9afc-2f371e4a9d10] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9795ee0-6722-4e1e-8fc8-a6c2e68f3049',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118726) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 19:20:55.126003 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-efe6d147-8e4b-4b64-a6d9-0e2cfb6faa11 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.143033 Oct 31 19:20:55.126858 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 10/23] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 31 19:20:52 2022] POST /compute/v2.1/servers => generated 383 bytes in 2145 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 19:20:55.140601 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-80fd0f06-d100-4273-850a-e3c9189558f1 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:20:55.141677 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-80fd0f06-d100-4273-850a-e3c9189558f1 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 7a47cd33-e4a0-4b78-9afc-2f371e4a9d10] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:20:55.336221 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-124242a5-18bd-4659-a4e7-727bc98bde04 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:20:55.336843 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-124242a5-18bd-4659-a4e7-727bc98bde04 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 24ad6e3e-6043-4eff-afb4-0c6039e825fa] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:20:55.356135 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-124242a5-18bd-4659-a4e7-727bc98bde04 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:20:55.359610 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-124242a5-18bd-4659-a4e7-727bc98bde04 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:20:55.360077 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-124242a5-18bd-4659-a4e7-727bc98bde04 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:20:55.360900 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-124242a5-18bd-4659-a4e7-727bc98bde04 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:20:55.364757 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-124242a5-18bd-4659-a4e7-727bc98bde04 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:20:55.366170 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-124242a5-18bd-4659-a4e7-727bc98bde04 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:20:55.384526 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-80fd0f06-d100-4273-850a-e3c9189558f1 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc49f9eb3114759b2889ed8972136d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cf63c76fc543428404002ae9a75b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:20:55.396221 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-80fd0f06-d100-4273-850a-e3c9189558f1 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/7a47cd33-e4a0-4b78-9afc-2f371e4a9d10" status: 200 len: 1221 microversion: 2.1 time: 0.260364 Oct 31 19:20:55.409630 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 14/24] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:20:55 2022] GET /compute/v2.1/servers/7a47cd33-e4a0-4b78-9afc-2f371e4a9d10 => generated 1221 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:20:55.612191 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-b974e028-c218-4440-ac24-65c02c77e287 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:20:55.613020 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-b974e028-c218-4440-ac24-65c02c77e287 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] [instance: 98a9a544-4553-4083-aa26-1dc327369d54] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:20:55.788066 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-b974e028-c218-4440-ac24-65c02c77e287 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af27927be0e249bfb320652152f501bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c549a25d33441e98aae78e940a69c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:20:55.796047 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-b974e028-c218-4440-ac24-65c02c77e287 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] 10.222.0.16 "GET /compute/v2.1/servers/98a9a544-4553-4083-aa26-1dc327369d54" status: 200 len: 1214 microversion: 2.1 time: 0.190606 Oct 31 19:20:55.799594 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 15/25] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:20:55 2022] GET /compute/v2.1/servers/98a9a544-4553-4083-aa26-1dc327369d54 => generated 1214 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:20:55.906335 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-124242a5-18bd-4659-a4e7-727bc98bde04 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:20:55.942024 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-124242a5-18bd-4659-a4e7-727bc98bde04 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:20:55.944133 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-124242a5-18bd-4659-a4e7-727bc98bde04 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:20:55.954377 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-124242a5-18bd-4659-a4e7-727bc98bde04 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa" status: 200 len: 1277 microversion: 2.20 time: 0.622272 Oct 31 19:20:55.969095 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 11/26] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 31 19:20:55 2022] GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa => generated 1277 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 19:20:56.191527 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-3a9e0677-e92a-4874-80e3-08fbac1c6a16 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-257493362", "imageRef": "a9795ee0-6722-4e1e-8fc8-a6c2e68f3049", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:20:56.313313 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.network.neutron [None req-3a9e0677-e92a-4874-80e3-08fbac1c6a16 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] validate_networks() for [('76d0a169-b981-4155-bbd7-0bbdbbf23238', None, None, None, None, None)] {{(pid=118727) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 19:20:56.834352 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-9930c86d-5309-43b6-a2c9-cf86ebfacc6b tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:20:56.840920 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-9930c86d-5309-43b6-a2c9-cf86ebfacc6b tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] [instance: 98a9a544-4553-4083-aa26-1dc327369d54] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:20:56.865006 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-9930c86d-5309-43b6-a2c9-cf86ebfacc6b tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:20:56.865637 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-9930c86d-5309-43b6-a2c9-cf86ebfacc6b tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:20:56.866094 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-9930c86d-5309-43b6-a2c9-cf86ebfacc6b tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:20:56.866882 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-9930c86d-5309-43b6-a2c9-cf86ebfacc6b tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:20:56.879259 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-9930c86d-5309-43b6-a2c9-cf86ebfacc6b tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:20:56.883624 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-9930c86d-5309-43b6-a2c9-cf86ebfacc6b tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:20:57.061137 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-9930c86d-5309-43b6-a2c9-cf86ebfacc6b tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af27927be0e249bfb320652152f501bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c549a25d33441e98aae78e940a69c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:20:57.074459 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-9930c86d-5309-43b6-a2c9-cf86ebfacc6b tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] 10.222.0.16 "GET /compute/v2.1/servers/98a9a544-4553-4083-aa26-1dc327369d54" status: 200 len: 1210 microversion: 2.1 time: 0.253442 Oct 31 19:20:57.089710 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 12/27] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:20:56 2022] GET /compute/v2.1/servers/98a9a544-4553-4083-aa26-1dc327369d54 => generated 1210 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 19:20:57.115980 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-51d13b7c-1803-499e-8501-585c0d6e4b9f tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:20:57.116929 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-51d13b7c-1803-499e-8501-585c0d6e4b9f tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 24ad6e3e-6043-4eff-afb4-0c6039e825fa] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:20:57.127870 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-51d13b7c-1803-499e-8501-585c0d6e4b9f tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:20:57.134394 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-51d13b7c-1803-499e-8501-585c0d6e4b9f tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:20:57.135249 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-51d13b7c-1803-499e-8501-585c0d6e4b9f tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:20:57.136232 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-51d13b7c-1803-499e-8501-585c0d6e4b9f tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:20:57.136903 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-51d13b7c-1803-499e-8501-585c0d6e4b9f tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:20:57.137531 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-51d13b7c-1803-499e-8501-585c0d6e4b9f tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:20:57.481993 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-51d13b7c-1803-499e-8501-585c0d6e4b9f tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:20:57.499554 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-51d13b7c-1803-499e-8501-585c0d6e4b9f tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:20:57.509692 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-51d13b7c-1803-499e-8501-585c0d6e4b9f tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:20:57.516412 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-51d13b7c-1803-499e-8501-585c0d6e4b9f tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa" status: 200 len: 1341 microversion: 2.20 time: 0.424011 Oct 31 19:20:57.519985 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 13/28] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 31 19:20:57 2022] GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa => generated 1341 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 19:20:58.117193 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-4d3cd883-9aad-4ebc-aa08-2ff7c4fb54f3 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:20:58.117962 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-4d3cd883-9aad-4ebc-aa08-2ff7c4fb54f3 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] [instance: 98a9a544-4553-4083-aa26-1dc327369d54] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:20:58.140407 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-4d3cd883-9aad-4ebc-aa08-2ff7c4fb54f3 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:20:58.141085 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-4d3cd883-9aad-4ebc-aa08-2ff7c4fb54f3 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:20:58.141742 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-4d3cd883-9aad-4ebc-aa08-2ff7c4fb54f3 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:20:58.145234 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-4d3cd883-9aad-4ebc-aa08-2ff7c4fb54f3 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:20:58.147438 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-4d3cd883-9aad-4ebc-aa08-2ff7c4fb54f3 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:20:58.147977 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-4d3cd883-9aad-4ebc-aa08-2ff7c4fb54f3 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:20:58.159551 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.virt.hardware [None req-3a9e0677-e92a-4874-80e3-08fbac1c6a16 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Flavor limits 0:0:0 {{(pid=118727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 19:20:58.160116 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.virt.hardware [None req-3a9e0677-e92a-4874-80e3-08fbac1c6a16 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Image limits 0:0:0 {{(pid=118727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 19:20:58.160116 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.virt.hardware [None req-3a9e0677-e92a-4874-80e3-08fbac1c6a16 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Flavor pref 0:0:0 {{(pid=118727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 19:20:58.160501 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.virt.hardware [None req-3a9e0677-e92a-4874-80e3-08fbac1c6a16 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Image pref 0:0:0 {{(pid=118727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 19:20:58.160923 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.virt.hardware [None req-3a9e0677-e92a-4874-80e3-08fbac1c6a16 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 19:20:58.189106 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-3a9e0677-e92a-4874-80e3-08fbac1c6a16 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:20:58.191084 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-3a9e0677-e92a-4874-80e3-08fbac1c6a16 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:20:58.193038 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-3a9e0677-e92a-4874-80e3-08fbac1c6a16 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:20:58.195583 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-3a9e0677-e92a-4874-80e3-08fbac1c6a16 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:20:58.198333 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-3a9e0677-e92a-4874-80e3-08fbac1c6a16 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:20:58.201143 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-3a9e0677-e92a-4874-80e3-08fbac1c6a16 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:20:58.276544 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.quota [None req-3a9e0677-e92a-4874-80e3-08fbac1c6a16 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Getting quotas for project 73cf63c76fc543428404002ae9a75b29. Resources: {'instances', 'ram', 'cores'} {{(pid=118727) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 19:20:58.295444 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.quota [None req-3a9e0677-e92a-4874-80e3-08fbac1c6a16 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Getting quotas for user ddc49f9eb3114759b2889ed8972136d8 and project 73cf63c76fc543428404002ae9a75b29. Resources: {'instances', 'ram', 'cores'} {{(pid=118727) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 19:20:58.381401 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-3a9e0677-e92a-4874-80e3-08fbac1c6a16 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Going to run 1 instances... {{(pid=118727) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 19:20:58.394753 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-3a9e0677-e92a-4874-80e3-08fbac1c6a16 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 37698c73-94da-4904-a8d5-636936092fba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9795ee0-6722-4e1e-8fc8-a6c2e68f3049',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118727) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 19:20:58.541486 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-3a9e0677-e92a-4874-80e3-08fbac1c6a16 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.355906 Oct 31 19:20:58.543543 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 16/29] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 31 19:20:56 2022] POST /compute/v2.1/servers => generated 383 bytes in 2358 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 19:20:58.557892 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-46d5c584-522c-4fbb-a16b-0463a860cad0 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:20:58.559137 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-46d5c584-522c-4fbb-a16b-0463a860cad0 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 24ad6e3e-6043-4eff-afb4-0c6039e825fa] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:20:58.586420 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-46d5c584-522c-4fbb-a16b-0463a860cad0 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:20:58.587097 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-46d5c584-522c-4fbb-a16b-0463a860cad0 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:20:58.589453 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-46d5c584-522c-4fbb-a16b-0463a860cad0 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:20:58.590404 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-46d5c584-522c-4fbb-a16b-0463a860cad0 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:20:58.592187 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-46d5c584-522c-4fbb-a16b-0463a860cad0 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:20:58.593754 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-46d5c584-522c-4fbb-a16b-0463a860cad0 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:20:59.102602 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-4d3cd883-9aad-4ebc-aa08-2ff7c4fb54f3 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af27927be0e249bfb320652152f501bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c549a25d33441e98aae78e940a69c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:20:59.110637 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-4d3cd883-9aad-4ebc-aa08-2ff7c4fb54f3 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] 10.222.0.16 "GET /compute/v2.1/servers/98a9a544-4553-4083-aa26-1dc327369d54" status: 200 len: 1284 microversion: 2.1 time: 0.998642 Oct 31 19:20:59.119708 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 14/30] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:20:58 2022] GET /compute/v2.1/servers/98a9a544-4553-4083-aa26-1dc327369d54 => generated 1284 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:20:59.136701 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-c8db69f8-8ab7-4645-b389-adf5ae6857b4 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:20:59.136701 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-c8db69f8-8ab7-4645-b389-adf5ae6857b4 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 37698c73-94da-4904-a8d5-636936092fba] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:20:59.209998 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-46d5c584-522c-4fbb-a16b-0463a860cad0 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:20:59.263348 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-46d5c584-522c-4fbb-a16b-0463a860cad0 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:20:59.277276 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-46d5c584-522c-4fbb-a16b-0463a860cad0 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:20:59.288830 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-46d5c584-522c-4fbb-a16b-0463a860cad0 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa" status: 200 len: 1339 microversion: 2.20 time: 0.730625 Oct 31 19:20:59.289496 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 17/31] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 31 19:20:58 2022] GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa => generated 1339 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 19:20:59.335522 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-f7ddba48-9642-407b-b688-57d76b5e3e8f tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1679466567", "imageRef": "a9795ee0-6722-4e1e-8fc8-a6c2e68f3049", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bb81951e-1ade-402e-8059-76bd3e08139a"}], "security_groups": [{"name": "tempest-securitygroup--334617367"}], "key_name": "tempest-keypair-656109420", "user_data": "}} {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:20:59.642376 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-c8db69f8-8ab7-4645-b389-adf5ae6857b4 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc49f9eb3114759b2889ed8972136d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cf63c76fc543428404002ae9a75b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:20:59.652344 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-c8db69f8-8ab7-4645-b389-adf5ae6857b4 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/37698c73-94da-4904-a8d5-636936092fba" status: 200 len: 1221 microversion: 2.1 time: 0.531535 Oct 31 19:20:59.656264 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 15/32] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:20:59 2022] GET /compute/v2.1/servers/37698c73-94da-4904-a8d5-636936092fba => generated 1221 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:20:59.869381 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.network.neutron [None req-f7ddba48-9642-407b-b688-57d76b5e3e8f tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] validate_networks() for [('bb81951e-1ade-402e-8059-76bd3e08139a', None, None, None, None, None)] {{(pid=118727) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 19:21:00.143248 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-be80d833-5e9f-4226-a9d9-b014388e2455 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:21:00.143916 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-be80d833-5e9f-4226-a9d9-b014388e2455 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] [instance: 98a9a544-4553-4083-aa26-1dc327369d54] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:21:00.158709 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-be80d833-5e9f-4226-a9d9-b014388e2455 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:00.162786 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-be80d833-5e9f-4226-a9d9-b014388e2455 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:00.165464 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-be80d833-5e9f-4226-a9d9-b014388e2455 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:00.167932 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-be80d833-5e9f-4226-a9d9-b014388e2455 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:00.168637 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-be80d833-5e9f-4226-a9d9-b014388e2455 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:00.171354 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-be80d833-5e9f-4226-a9d9-b014388e2455 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:00.492545 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-be80d833-5e9f-4226-a9d9-b014388e2455 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af27927be0e249bfb320652152f501bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c549a25d33441e98aae78e940a69c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:21:00.507798 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-be80d833-5e9f-4226-a9d9-b014388e2455 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] 10.222.0.16 "GET /compute/v2.1/servers/98a9a544-4553-4083-aa26-1dc327369d54" status: 200 len: 1272 microversion: 2.1 time: 0.368853 Oct 31 19:21:00.511947 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 16/33] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:21:00 2022] GET /compute/v2.1/servers/98a9a544-4553-4083-aa26-1dc327369d54 => generated 1272 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:21:00.539070 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-dda333bf-bdcc-49c8-829f-c17d32718c15 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:21:00.540068 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-dda333bf-bdcc-49c8-829f-c17d32718c15 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 24ad6e3e-6043-4eff-afb4-0c6039e825fa] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:21:00.549923 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-dda333bf-bdcc-49c8-829f-c17d32718c15 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:00.550708 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-dda333bf-bdcc-49c8-829f-c17d32718c15 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:00.551330 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-dda333bf-bdcc-49c8-829f-c17d32718c15 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:00.552331 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-dda333bf-bdcc-49c8-829f-c17d32718c15 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:00.553438 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-dda333bf-bdcc-49c8-829f-c17d32718c15 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:00.554416 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-dda333bf-bdcc-49c8-829f-c17d32718c15 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:01.862409 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-dda333bf-bdcc-49c8-829f-c17d32718c15 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:21:01.874627 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-dda333bf-bdcc-49c8-829f-c17d32718c15 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:21:01.880382 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-dda333bf-bdcc-49c8-829f-c17d32718c15 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:21:01.883240 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-dda333bf-bdcc-49c8-829f-c17d32718c15 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa" status: 200 len: 1339 microversion: 2.20 time: 1.369592 Oct 31 19:21:01.886634 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 17/34] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 31 19:21:00 2022] GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa => generated 1339 bytes in 1374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 19:21:01.897679 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-864b3f46-5aa4-4060-914c-c07a2dcf461a tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:21:01.898795 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-864b3f46-5aa4-4060-914c-c07a2dcf461a tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 37698c73-94da-4904-a8d5-636936092fba] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:21:01.913742 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-864b3f46-5aa4-4060-914c-c07a2dcf461a tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:01.914651 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-864b3f46-5aa4-4060-914c-c07a2dcf461a tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:01.919541 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-864b3f46-5aa4-4060-914c-c07a2dcf461a tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:01.920580 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-864b3f46-5aa4-4060-914c-c07a2dcf461a tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:01.921262 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-864b3f46-5aa4-4060-914c-c07a2dcf461a tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:01.921898 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-864b3f46-5aa4-4060-914c-c07a2dcf461a tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:02.139948 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-864b3f46-5aa4-4060-914c-c07a2dcf461a tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc49f9eb3114759b2889ed8972136d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cf63c76fc543428404002ae9a75b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:21:02.148766 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-864b3f46-5aa4-4060-914c-c07a2dcf461a tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/37698c73-94da-4904-a8d5-636936092fba" status: 200 len: 1279 microversion: 2.1 time: 0.260570 Oct 31 19:21:02.154105 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 18/35] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:21:01 2022] GET /compute/v2.1/servers/37698c73-94da-4904-a8d5-636936092fba => generated 1279 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:21:02.196155 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-5c25d4e5-f0b4-4da8-af06-d2bdcd6f7113 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:21:02.198506 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-5c25d4e5-f0b4-4da8-af06-d2bdcd6f7113 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] [instance: 98a9a544-4553-4083-aa26-1dc327369d54] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:21:02.211155 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-5c25d4e5-f0b4-4da8-af06-d2bdcd6f7113 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:02.215921 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-5c25d4e5-f0b4-4da8-af06-d2bdcd6f7113 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:02.216633 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-5c25d4e5-f0b4-4da8-af06-d2bdcd6f7113 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:02.218129 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-5c25d4e5-f0b4-4da8-af06-d2bdcd6f7113 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:02.220626 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-5c25d4e5-f0b4-4da8-af06-d2bdcd6f7113 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:02.221280 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-5c25d4e5-f0b4-4da8-af06-d2bdcd6f7113 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:03.434807 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.virt.hardware [None req-f7ddba48-9642-407b-b688-57d76b5e3e8f tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Flavor limits 0:0:0 {{(pid=118727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 19:21:03.435552 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.virt.hardware [None req-f7ddba48-9642-407b-b688-57d76b5e3e8f tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Image limits 0:0:0 {{(pid=118727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 19:21:03.436047 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.virt.hardware [None req-f7ddba48-9642-407b-b688-57d76b5e3e8f tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Flavor pref 0:0:0 {{(pid=118727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 19:21:03.436689 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.virt.hardware [None req-f7ddba48-9642-407b-b688-57d76b5e3e8f tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Image pref 0:0:0 {{(pid=118727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 19:21:03.437314 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.virt.hardware [None req-f7ddba48-9642-407b-b688-57d76b5e3e8f tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 19:21:03.439521 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG dbcounter [-] [118727] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=8 {{(pid=118727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:21:03.486441 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-f7ddba48-9642-407b-b688-57d76b5e3e8f tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:03.495353 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-f7ddba48-9642-407b-b688-57d76b5e3e8f tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:03.498154 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-f7ddba48-9642-407b-b688-57d76b5e3e8f tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:03.504084 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-f7ddba48-9642-407b-b688-57d76b5e3e8f tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:03.509208 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-f7ddba48-9642-407b-b688-57d76b5e3e8f tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:03.510739 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-f7ddba48-9642-407b-b688-57d76b5e3e8f tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:03.594089 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.quota [None req-f7ddba48-9642-407b-b688-57d76b5e3e8f tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Getting quotas for project 3f9c317b548b40deb8cb27236d36d674. Resources: {'instances', 'ram', 'cores'} {{(pid=118727) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 19:21:03.608123 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.quota [None req-f7ddba48-9642-407b-b688-57d76b5e3e8f tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Getting quotas for user ece6ca9374764214bac6263bd691bc4d and project 3f9c317b548b40deb8cb27236d36d674. Resources: {'instances', 'ram', 'cores'} {{(pid=118727) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 19:21:03.657286 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-f7ddba48-9642-407b-b688-57d76b5e3e8f tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Going to run 1 instances... {{(pid=118727) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 19:21:03.669778 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-f7ddba48-9642-407b-b688-57d76b5e3e8f tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] [instance: 0a122a08-bc0f-40fd-8139-74c9e8a70ebe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9795ee0-6722-4e1e-8fc8-a6c2e68f3049',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118727) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 19:21:03.790710 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-5c25d4e5-f0b4-4da8-af06-d2bdcd6f7113 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af27927be0e249bfb320652152f501bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c549a25d33441e98aae78e940a69c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:21:03.804381 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-5c25d4e5-f0b4-4da8-af06-d2bdcd6f7113 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] 10.222.0.16 "GET /compute/v2.1/servers/98a9a544-4553-4083-aa26-1dc327369d54" status: 200 len: 1314 microversion: 2.1 time: 1.633055 Oct 31 19:21:03.809032 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 19/36] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:21:02 2022] GET /compute/v2.1/servers/98a9a544-4553-4083-aa26-1dc327369d54 => generated 1314 bytes in 1638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:21:03.826956 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-f569e6f9-8ac8-4fd3-8ee5-2320b65810cc tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:21:03.831958 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-f569e6f9-8ac8-4fd3-8ee5-2320b65810cc tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 24ad6e3e-6043-4eff-afb4-0c6039e825fa] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:21:03.847174 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-f7ddba48-9642-407b-b688-57d76b5e3e8f tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 4.554022 Oct 31 19:21:03.847862 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 18/37] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 31 19:20:59 2022] POST /compute/v2.1/servers => generated 401 bytes in 4555 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 19:21:03.862119 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-35a8b375-1500-4cb6-ae13-1b4170063775 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:21:03.870730 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-f569e6f9-8ac8-4fd3-8ee5-2320b65810cc tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:03.875488 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-f569e6f9-8ac8-4fd3-8ee5-2320b65810cc tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:03.876092 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-f569e6f9-8ac8-4fd3-8ee5-2320b65810cc tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:03.878281 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-f569e6f9-8ac8-4fd3-8ee5-2320b65810cc tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:03.882248 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-35a8b375-1500-4cb6-ae13-1b4170063775 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 37698c73-94da-4904-a8d5-636936092fba] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:21:03.883849 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-f569e6f9-8ac8-4fd3-8ee5-2320b65810cc tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:03.884514 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-f569e6f9-8ac8-4fd3-8ee5-2320b65810cc tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:03.907306 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-35a8b375-1500-4cb6-ae13-1b4170063775 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:03.907801 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-35a8b375-1500-4cb6-ae13-1b4170063775 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:03.910086 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-35a8b375-1500-4cb6-ae13-1b4170063775 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:03.914304 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-35a8b375-1500-4cb6-ae13-1b4170063775 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:03.914574 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-35a8b375-1500-4cb6-ae13-1b4170063775 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:03.915731 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-35a8b375-1500-4cb6-ae13-1b4170063775 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:04.102234 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-35a8b375-1500-4cb6-ae13-1b4170063775 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc49f9eb3114759b2889ed8972136d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cf63c76fc543428404002ae9a75b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:21:04.113037 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-35a8b375-1500-4cb6-ae13-1b4170063775 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/37698c73-94da-4904-a8d5-636936092fba" status: 200 len: 1279 microversion: 2.1 time: 0.260599 Oct 31 19:21:04.113825 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 19/38] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:21:03 2022] GET /compute/v2.1/servers/37698c73-94da-4904-a8d5-636936092fba => generated 1279 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:21:04.126366 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-d3359bae-102b-4776-9649-806393443705 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:21:04.127004 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-d3359bae-102b-4776-9649-806393443705 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] [instance: 0a122a08-bc0f-40fd-8139-74c9e8a70ebe] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:21:04.302411 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-f569e6f9-8ac8-4fd3-8ee5-2320b65810cc tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:21:04.316662 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-f569e6f9-8ac8-4fd3-8ee5-2320b65810cc tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:21:04.319329 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-f569e6f9-8ac8-4fd3-8ee5-2320b65810cc tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:21:04.323072 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-f569e6f9-8ac8-4fd3-8ee5-2320b65810cc tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa" status: 200 len: 1407 microversion: 2.20 time: 0.505832 Oct 31 19:21:04.329324 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-d3359bae-102b-4776-9649-806393443705 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ece6ca9374764214bac6263bd691bc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9c317b548b40deb8cb27236d36d674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:21:04.339071 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 20/39] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 31 19:21:03 2022] GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa => generated 1407 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 19:21:04.350256 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-d3359bae-102b-4776-9649-806393443705 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] 10.222.0.16 "GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe" status: 200 len: 1237 microversion: 2.1 time: 0.235057 Oct 31 19:21:04.359765 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 20/40] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:21:04 2022] GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe => generated 1237 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:21:04.836673 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-c04c4808-d64e-4a29-ae71-a0db237c6ad2 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:21:04.837335 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-c04c4808-d64e-4a29-ae71-a0db237c6ad2 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] [instance: 98a9a544-4553-4083-aa26-1dc327369d54] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:21:04.850421 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-c04c4808-d64e-4a29-ae71-a0db237c6ad2 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:04.851916 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-c04c4808-d64e-4a29-ae71-a0db237c6ad2 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:04.854494 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-c04c4808-d64e-4a29-ae71-a0db237c6ad2 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:04.857804 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-c04c4808-d64e-4a29-ae71-a0db237c6ad2 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:04.858523 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-c04c4808-d64e-4a29-ae71-a0db237c6ad2 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:04.859760 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-c04c4808-d64e-4a29-ae71-a0db237c6ad2 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:04.977754 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG dbcounter [-] [118726] Writing DB stats nova_cell0:SELECT=4 {{(pid=118726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:21:05.139419 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-2ceb1b75-82be-4271-bef9-0a5665384f1a tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:21:05.140715 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-2ceb1b75-82be-4271-bef9-0a5665384f1a tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 37698c73-94da-4904-a8d5-636936092fba] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:21:05.149307 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-2ceb1b75-82be-4271-bef9-0a5665384f1a tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:05.151773 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-2ceb1b75-82be-4271-bef9-0a5665384f1a tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:05.152493 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-2ceb1b75-82be-4271-bef9-0a5665384f1a tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:05.156035 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-2ceb1b75-82be-4271-bef9-0a5665384f1a tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:05.156794 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-2ceb1b75-82be-4271-bef9-0a5665384f1a tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:05.157719 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-2ceb1b75-82be-4271-bef9-0a5665384f1a tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:05.201219 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-c04c4808-d64e-4a29-ae71-a0db237c6ad2 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af27927be0e249bfb320652152f501bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c549a25d33441e98aae78e940a69c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:21:05.215264 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-c04c4808-d64e-4a29-ae71-a0db237c6ad2 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] 10.222.0.16 "GET /compute/v2.1/servers/98a9a544-4553-4083-aa26-1dc327369d54" status: 200 len: 1314 microversion: 2.1 time: 0.384681 Oct 31 19:21:05.222910 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 21/41] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:21:04 2022] GET /compute/v2.1/servers/98a9a544-4553-4083-aa26-1dc327369d54 => generated 1314 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:21:05.290144 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-2ceb1b75-82be-4271-bef9-0a5665384f1a tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc49f9eb3114759b2889ed8972136d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cf63c76fc543428404002ae9a75b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:21:05.301300 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-2ceb1b75-82be-4271-bef9-0a5665384f1a tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/37698c73-94da-4904-a8d5-636936092fba" status: 200 len: 1279 microversion: 2.1 time: 0.166322 Oct 31 19:21:05.303114 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 21/42] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:21:05 2022] GET /compute/v2.1/servers/37698c73-94da-4904-a8d5-636936092fba => generated 1279 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:21:05.355191 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-4a6b02b6-54ec-4172-8beb-f312087395f8 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:21:05.357355 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-4a6b02b6-54ec-4172-8beb-f312087395f8 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 24ad6e3e-6043-4eff-afb4-0c6039e825fa] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:21:05.382769 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-bd9383f6-2245-4d7a-abea-b807b999a9db tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:21:05.383739 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-bd9383f6-2245-4d7a-abea-b807b999a9db tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] [instance: 0a122a08-bc0f-40fd-8139-74c9e8a70ebe] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:21:05.403839 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-4a6b02b6-54ec-4172-8beb-f312087395f8 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:05.404345 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-4a6b02b6-54ec-4172-8beb-f312087395f8 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:05.410686 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-4a6b02b6-54ec-4172-8beb-f312087395f8 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:05.411688 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-4a6b02b6-54ec-4172-8beb-f312087395f8 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:05.412269 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-4a6b02b6-54ec-4172-8beb-f312087395f8 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:05.412609 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-4a6b02b6-54ec-4172-8beb-f312087395f8 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:05.421066 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-bd9383f6-2245-4d7a-abea-b807b999a9db tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:05.421593 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-bd9383f6-2245-4d7a-abea-b807b999a9db tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:05.422074 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-bd9383f6-2245-4d7a-abea-b807b999a9db tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:05.422811 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-bd9383f6-2245-4d7a-abea-b807b999a9db tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:05.428792 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-bd9383f6-2245-4d7a-abea-b807b999a9db tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:05.429287 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-bd9383f6-2245-4d7a-abea-b807b999a9db tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:05.751934 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-bd9383f6-2245-4d7a-abea-b807b999a9db tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ece6ca9374764214bac6263bd691bc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9c317b548b40deb8cb27236d36d674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:21:05.804205 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-bd9383f6-2245-4d7a-abea-b807b999a9db tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] 10.222.0.16 "GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe" status: 200 len: 1241 microversion: 2.1 time: 0.427491 Oct 31 19:21:05.806279 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 22/43] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:21:05 2022] GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe => generated 1241 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:21:06.242930 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-6ef77503-ff95-45d0-9cc2-09c85adc0681 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:21:06.247057 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-6ef77503-ff95-45d0-9cc2-09c85adc0681 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] [instance: 98a9a544-4553-4083-aa26-1dc327369d54] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:21:06.279504 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-6ef77503-ff95-45d0-9cc2-09c85adc0681 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:06.279973 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-6ef77503-ff95-45d0-9cc2-09c85adc0681 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:06.280428 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-6ef77503-ff95-45d0-9cc2-09c85adc0681 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:06.281937 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-6ef77503-ff95-45d0-9cc2-09c85adc0681 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:06.282577 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-6ef77503-ff95-45d0-9cc2-09c85adc0681 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:06.283162 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-6ef77503-ff95-45d0-9cc2-09c85adc0681 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:06.782545 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-4a6b02b6-54ec-4172-8beb-f312087395f8 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:21:06.794136 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-4a6b02b6-54ec-4172-8beb-f312087395f8 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:21:06.804474 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-4a6b02b6-54ec-4172-8beb-f312087395f8 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:21:06.812473 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-4a6b02b6-54ec-4172-8beb-f312087395f8 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa" status: 200 len: 1407 microversion: 2.20 time: 1.463570 Oct 31 19:21:06.816733 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 22/44] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 31 19:21:05 2022] GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa => generated 1407 bytes in 1469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 19:21:06.858070 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-7ca71bb9-eef2-4ef2-83c2-419c70313bf7 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:21:06.861644 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-7ca71bb9-eef2-4ef2-83c2-419c70313bf7 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 37698c73-94da-4904-a8d5-636936092fba] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:21:06.886837 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-7ca71bb9-eef2-4ef2-83c2-419c70313bf7 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:06.887681 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-7ca71bb9-eef2-4ef2-83c2-419c70313bf7 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:06.890254 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-7ca71bb9-eef2-4ef2-83c2-419c70313bf7 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:06.891112 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-7ca71bb9-eef2-4ef2-83c2-419c70313bf7 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:06.892997 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-7ca71bb9-eef2-4ef2-83c2-419c70313bf7 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:06.894578 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-7ca71bb9-eef2-4ef2-83c2-419c70313bf7 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:06.989804 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-6ef77503-ff95-45d0-9cc2-09c85adc0681 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af27927be0e249bfb320652152f501bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c549a25d33441e98aae78e940a69c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:21:07.003569 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-6ef77503-ff95-45d0-9cc2-09c85adc0681 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] 10.222.0.16 "GET /compute/v2.1/servers/98a9a544-4553-4083-aa26-1dc327369d54" status: 200 len: 1314 microversion: 2.1 time: 0.764603 Oct 31 19:21:07.006203 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 23/45] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:21:06 2022] GET /compute/v2.1/servers/98a9a544-4553-4083-aa26-1dc327369d54 => generated 1314 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 19:21:07.015763 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-ecaba684-d61c-4a68-95fc-94b77aa2010b tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:21:07.019519 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-ecaba684-d61c-4a68-95fc-94b77aa2010b tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] [instance: 0a122a08-bc0f-40fd-8139-74c9e8a70ebe] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:21:07.038224 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-ecaba684-d61c-4a68-95fc-94b77aa2010b tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:07.041370 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-ecaba684-d61c-4a68-95fc-94b77aa2010b tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:07.042958 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-ecaba684-d61c-4a68-95fc-94b77aa2010b tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:07.045971 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-ecaba684-d61c-4a68-95fc-94b77aa2010b tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:07.046615 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-ecaba684-d61c-4a68-95fc-94b77aa2010b tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:07.048719 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-ecaba684-d61c-4a68-95fc-94b77aa2010b tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:07.310555 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-ecaba684-d61c-4a68-95fc-94b77aa2010b tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ece6ca9374764214bac6263bd691bc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9c317b548b40deb8cb27236d36d674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:21:07.322553 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-ecaba684-d61c-4a68-95fc-94b77aa2010b tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] 10.222.0.16 "GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe" status: 200 len: 1289 microversion: 2.1 time: 0.315074 Oct 31 19:21:07.327601 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 24/46] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:21:07 2022] GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe => generated 1289 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:21:07.845944 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-63164ad9-b211-4021-acb3-ea527c92fe66 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:21:07.846561 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-63164ad9-b211-4021-acb3-ea527c92fe66 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 24ad6e3e-6043-4eff-afb4-0c6039e825fa] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:21:07.855481 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-63164ad9-b211-4021-acb3-ea527c92fe66 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:07.868951 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-63164ad9-b211-4021-acb3-ea527c92fe66 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:07.869821 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-63164ad9-b211-4021-acb3-ea527c92fe66 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:07.871916 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-63164ad9-b211-4021-acb3-ea527c92fe66 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:07.874425 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-63164ad9-b211-4021-acb3-ea527c92fe66 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:07.875412 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-63164ad9-b211-4021-acb3-ea527c92fe66 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:08.304532 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-7ca71bb9-eef2-4ef2-83c2-419c70313bf7 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc49f9eb3114759b2889ed8972136d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cf63c76fc543428404002ae9a75b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:21:08.327579 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-7ca71bb9-eef2-4ef2-83c2-419c70313bf7 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/37698c73-94da-4904-a8d5-636936092fba" status: 200 len: 1321 microversion: 2.1 time: 1.505286 Oct 31 19:21:08.329549 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 23/47] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:21:06 2022] GET /compute/v2.1/servers/37698c73-94da-4904-a8d5-636936092fba => generated 1321 bytes in 1512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:21:08.346276 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-e4262432-755d-4e2a-857d-b6ce49e47ecf tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:21:08.357148 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-e4262432-755d-4e2a-857d-b6ce49e47ecf tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] [instance: 98a9a544-4553-4083-aa26-1dc327369d54] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:21:08.389690 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-e4262432-755d-4e2a-857d-b6ce49e47ecf tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:08.390195 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-e4262432-755d-4e2a-857d-b6ce49e47ecf tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:08.390631 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-e4262432-755d-4e2a-857d-b6ce49e47ecf tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:08.397957 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-e4262432-755d-4e2a-857d-b6ce49e47ecf tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:08.400663 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-e4262432-755d-4e2a-857d-b6ce49e47ecf tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:08.402159 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-e4262432-755d-4e2a-857d-b6ce49e47ecf tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:09.148403 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-e4262432-755d-4e2a-857d-b6ce49e47ecf tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af27927be0e249bfb320652152f501bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c549a25d33441e98aae78e940a69c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:21:09.156637 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-e4262432-755d-4e2a-857d-b6ce49e47ecf tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] 10.222.0.16 "GET /compute/v2.1/servers/98a9a544-4553-4083-aa26-1dc327369d54" status: 200 len: 1314 microversion: 2.1 time: 0.824773 Oct 31 19:21:09.164810 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 24/48] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:21:08 2022] GET /compute/v2.1/servers/98a9a544-4553-4083-aa26-1dc327369d54 => generated 1314 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:21:09.171964 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-b5418947-83e4-4554-bd87-0c11b8234f5a tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:21:09.177423 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-b5418947-83e4-4554-bd87-0c11b8234f5a tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] [instance: 0a122a08-bc0f-40fd-8139-74c9e8a70ebe] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:21:09.194204 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-b5418947-83e4-4554-bd87-0c11b8234f5a tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:09.194698 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-b5418947-83e4-4554-bd87-0c11b8234f5a tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:09.195140 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-b5418947-83e4-4554-bd87-0c11b8234f5a tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:09.195849 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-b5418947-83e4-4554-bd87-0c11b8234f5a tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:09.196481 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-b5418947-83e4-4554-bd87-0c11b8234f5a tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:09.206462 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-b5418947-83e4-4554-bd87-0c11b8234f5a tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:09.496284 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-b5418947-83e4-4554-bd87-0c11b8234f5a tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ece6ca9374764214bac6263bd691bc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9c317b548b40deb8cb27236d36d674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:21:09.504517 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-b5418947-83e4-4554-bd87-0c11b8234f5a tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] 10.222.0.16 "GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe" status: 200 len: 1295 microversion: 2.1 time: 0.338151 Oct 31 19:21:09.509384 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 25/49] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:21:09 2022] GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe => generated 1295 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:21:09.526989 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-63164ad9-b211-4021-acb3-ea527c92fe66 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:21:09.534513 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-219af902-a18b-4c21-90b7-df688da3d751 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:21:09.542419 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-219af902-a18b-4c21-90b7-df688da3d751 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 37698c73-94da-4904-a8d5-636936092fba] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:21:09.546815 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-63164ad9-b211-4021-acb3-ea527c92fe66 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:21:09.559583 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-63164ad9-b211-4021-acb3-ea527c92fe66 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:21:09.567826 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-219af902-a18b-4c21-90b7-df688da3d751 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:09.573269 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-219af902-a18b-4c21-90b7-df688da3d751 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:09.573995 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-219af902-a18b-4c21-90b7-df688da3d751 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:09.574901 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-219af902-a18b-4c21-90b7-df688da3d751 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:09.576623 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-219af902-a18b-4c21-90b7-df688da3d751 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:09.578230 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-219af902-a18b-4c21-90b7-df688da3d751 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:09.585883 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-63164ad9-b211-4021-acb3-ea527c92fe66 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa" status: 200 len: 1407 microversion: 2.20 time: 1.743728 Oct 31 19:21:09.603256 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 25/50] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 31 19:21:07 2022] GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa => generated 1407 bytes in 1763 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 19:21:09.646529 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG dbcounter [-] [118726] Writing DB stats nova_cell0:SELECT=16 {{(pid=118726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:21:10.188809 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-27c74f8c-396d-4215-993f-2941d517143f tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:21:10.189682 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-27c74f8c-396d-4215-993f-2941d517143f tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] [instance: 98a9a544-4553-4083-aa26-1dc327369d54] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:21:10.210605 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-27c74f8c-396d-4215-993f-2941d517143f tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:10.211793 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-27c74f8c-396d-4215-993f-2941d517143f tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:10.212451 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-27c74f8c-396d-4215-993f-2941d517143f tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:10.213364 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-27c74f8c-396d-4215-993f-2941d517143f tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:10.214049 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-27c74f8c-396d-4215-993f-2941d517143f tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:10.214693 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-27c74f8c-396d-4215-993f-2941d517143f tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:10.608636 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-219af902-a18b-4c21-90b7-df688da3d751 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc49f9eb3114759b2889ed8972136d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cf63c76fc543428404002ae9a75b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:21:10.618454 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-219af902-a18b-4c21-90b7-df688da3d751 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/37698c73-94da-4904-a8d5-636936092fba" status: 200 len: 1321 microversion: 2.1 time: 1.107220 Oct 31 19:21:10.619013 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 26/51] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:21:09 2022] GET /compute/v2.1/servers/37698c73-94da-4904-a8d5-636936092fba => generated 1321 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:21:10.668007 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-7c8431a4-55f5-4c97-abe9-89e4fb71fdcd tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:21:10.673251 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-7c8431a4-55f5-4c97-abe9-89e4fb71fdcd tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] [instance: 0a122a08-bc0f-40fd-8139-74c9e8a70ebe] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:21:10.702090 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-7c8431a4-55f5-4c97-abe9-89e4fb71fdcd tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:10.703329 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-7c8431a4-55f5-4c97-abe9-89e4fb71fdcd tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:10.706081 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-7c8431a4-55f5-4c97-abe9-89e4fb71fdcd tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:10.709601 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-7c8431a4-55f5-4c97-abe9-89e4fb71fdcd tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:10.710375 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-7c8431a4-55f5-4c97-abe9-89e4fb71fdcd tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:10.712362 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-7c8431a4-55f5-4c97-abe9-89e4fb71fdcd tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:10.873460 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-7c8431a4-55f5-4c97-abe9-89e4fb71fdcd tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ece6ca9374764214bac6263bd691bc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9c317b548b40deb8cb27236d36d674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:21:10.877646 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG dbcounter [-] [118726] Writing DB stats nova_cell1:SELECT=100 {{(pid=118726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:21:10.887285 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-7c8431a4-55f5-4c97-abe9-89e4fb71fdcd tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] 10.222.0.16 "GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe" status: 200 len: 1295 microversion: 2.1 time: 0.252833 Oct 31 19:21:10.890310 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 27/52] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:21:10 2022] GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe => generated 1295 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:21:10.909313 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-64eb7025-c509-4d38-92e2-d424e229e5ee tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:21:10.921862 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-64eb7025-c509-4d38-92e2-d424e229e5ee tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 24ad6e3e-6043-4eff-afb4-0c6039e825fa] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:21:10.947754 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-64eb7025-c509-4d38-92e2-d424e229e5ee tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:10.949732 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-64eb7025-c509-4d38-92e2-d424e229e5ee tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:10.951887 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-64eb7025-c509-4d38-92e2-d424e229e5ee tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:10.955365 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-64eb7025-c509-4d38-92e2-d424e229e5ee tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:10.959799 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-64eb7025-c509-4d38-92e2-d424e229e5ee tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:10.962637 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-64eb7025-c509-4d38-92e2-d424e229e5ee tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:11.725645 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-27c74f8c-396d-4215-993f-2941d517143f tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af27927be0e249bfb320652152f501bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c549a25d33441e98aae78e940a69c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:21:11.772167 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-27c74f8c-396d-4215-993f-2941d517143f tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] 10.222.0.16 "GET /compute/v2.1/servers/98a9a544-4553-4083-aa26-1dc327369d54" status: 200 len: 1314 microversion: 2.1 time: 1.586597 Oct 31 19:21:11.798474 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 26/53] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:21:10 2022] GET /compute/v2.1/servers/98a9a544-4553-4083-aa26-1dc327369d54 => generated 1314 bytes in 1616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:21:11.805990 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-877e2f5b-d632-4212-af66-c6b577c81e92 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:21:11.814260 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-877e2f5b-d632-4212-af66-c6b577c81e92 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 37698c73-94da-4904-a8d5-636936092fba] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:21:11.837562 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-877e2f5b-d632-4212-af66-c6b577c81e92 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:11.839107 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-877e2f5b-d632-4212-af66-c6b577c81e92 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:11.839967 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-877e2f5b-d632-4212-af66-c6b577c81e92 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:11.842411 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-877e2f5b-d632-4212-af66-c6b577c81e92 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:11.843650 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-877e2f5b-d632-4212-af66-c6b577c81e92 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:11.844456 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-877e2f5b-d632-4212-af66-c6b577c81e92 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:12.194997 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-64eb7025-c509-4d38-92e2-d424e229e5ee tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:21:12.214116 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-64eb7025-c509-4d38-92e2-d424e229e5ee tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:21:12.215651 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-64eb7025-c509-4d38-92e2-d424e229e5ee tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:21:12.216873 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-64eb7025-c509-4d38-92e2-d424e229e5ee tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa" status: 200 len: 1407 microversion: 2.20 time: 1.325405 Oct 31 19:21:12.225974 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 28/54] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 31 19:21:10 2022] GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa => generated 1407 bytes in 1335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 19:21:12.233735 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-5d85557a-b32c-4a56-a905-6d43f956a46e tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:21:12.234355 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-5d85557a-b32c-4a56-a905-6d43f956a46e tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] [instance: 0a122a08-bc0f-40fd-8139-74c9e8a70ebe] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:21:12.254387 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-5d85557a-b32c-4a56-a905-6d43f956a46e tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:12.254962 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-5d85557a-b32c-4a56-a905-6d43f956a46e tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:12.255406 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-5d85557a-b32c-4a56-a905-6d43f956a46e tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:12.256132 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-5d85557a-b32c-4a56-a905-6d43f956a46e tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:12.256595 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-5d85557a-b32c-4a56-a905-6d43f956a46e tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:12.257022 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-5d85557a-b32c-4a56-a905-6d43f956a46e tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:13.030594 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-5d85557a-b32c-4a56-a905-6d43f956a46e tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ece6ca9374764214bac6263bd691bc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9c317b548b40deb8cb27236d36d674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:21:13.048680 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-5d85557a-b32c-4a56-a905-6d43f956a46e tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] 10.222.0.16 "GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe" status: 200 len: 1362 microversion: 2.1 time: 0.821551 Oct 31 19:21:13.051112 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 29/55] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:21:12 2022] GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe => generated 1362 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:21:13.328699 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-877e2f5b-d632-4212-af66-c6b577c81e92 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc49f9eb3114759b2889ed8972136d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cf63c76fc543428404002ae9a75b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:21:13.342955 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [req-df4d7cae-b843-43a2-951f-cb64bfc4924f req-9b3e7388-819f-47cc-b816-abf2eefdec60 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37698c73-94da-4904-a8d5-636936092fba", "tag": "ac17eb8a-95b3-4c82-b434-4b9b13313e65"}]} {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:21:13.368790 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [req-df4d7cae-b843-43a2-951f-cb64bfc4924f req-9b3e7388-819f-47cc-b816-abf2eefdec60 service nova] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:13.372918 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [req-df4d7cae-b843-43a2-951f-cb64bfc4924f req-9b3e7388-819f-47cc-b816-abf2eefdec60 service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:13.374816 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [req-df4d7cae-b843-43a2-951f-cb64bfc4924f req-9b3e7388-819f-47cc-b816-abf2eefdec60 service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:13.375320 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-877e2f5b-d632-4212-af66-c6b577c81e92 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/37698c73-94da-4904-a8d5-636936092fba" status: 200 len: 1321 microversion: 2.1 time: 1.575193 Oct 31 19:21:13.378848 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 27/56] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:21:11 2022] GET /compute/v2.1/servers/37698c73-94da-4904-a8d5-636936092fba => generated 1321 bytes in 1580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:21:13.393358 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-e69a4209-11bc-4e30-9d8e-9075660d9818 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:21:13.397303 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-e69a4209-11bc-4e30-9d8e-9075660d9818 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] [instance: 98a9a544-4553-4083-aa26-1dc327369d54] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:21:13.417372 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-e69a4209-11bc-4e30-9d8e-9075660d9818 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:13.418236 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-e69a4209-11bc-4e30-9d8e-9075660d9818 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:13.420319 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-e69a4209-11bc-4e30-9d8e-9075660d9818 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:13.422350 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-e69a4209-11bc-4e30-9d8e-9075660d9818 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:13.424253 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-e69a4209-11bc-4e30-9d8e-9075660d9818 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:13.428352 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-e69a4209-11bc-4e30-9d8e-9075660d9818 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:13.431446 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.compute.server_external_events [req-df4d7cae-b843-43a2-951f-cb64bfc4924f req-9b3e7388-819f-47cc-b816-abf2eefdec60 service nova] Creating event network-changed:ac17eb8a-95b3-4c82-b434-4b9b13313e65 for instance 37698c73-94da-4904-a8d5-636936092fba on hv-cinder-86309 Oct 31 19:21:13.434372 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [req-df4d7cae-b843-43a2-951f-cb64bfc4924f req-9b3e7388-819f-47cc-b816-abf2eefdec60 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=118726) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 31 19:21:13.435895 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [req-df4d7cae-b843-43a2-951f-cb64bfc4924f req-9b3e7388-819f-47cc-b816-abf2eefdec60 service nova] Acquired lock "compute-rpcapi-router" {{(pid=118726) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 31 19:21:13.438205 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-8bfa05e4-0147-4fd1-8c05-644b95d7e987 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:13.440973 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-8bfa05e4-0147-4fd1-8c05-644b95d7e987 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:13.442901 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-8bfa05e4-0147-4fd1-8c05-644b95d7e987 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:13.446739 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-8bfa05e4-0147-4fd1-8c05-644b95d7e987 None None] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:13.448193 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-8bfa05e4-0147-4fd1-8c05-644b95d7e987 None None] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:13.450533 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-8bfa05e4-0147-4fd1-8c05-644b95d7e987 None None] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:13.478059 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.compute.rpcapi [None req-8bfa05e4-0147-4fd1-8c05-644b95d7e987 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 31 19:21:13.498742 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-8bfa05e4-0147-4fd1-8c05-644b95d7e987 None None] Releasing lock "compute-rpcapi-router" {{(pid=118726) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 31 19:21:13.538565 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-8bfa05e4-0147-4fd1-8c05-644b95d7e987 None None] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.484112 Oct 31 19:21:13.540305 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 30/57] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 31 19:21:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:21:13.545881 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG dbcounter [-] [118727] Writing DB stats nova_cell0:SELECT=6 {{(pid=118727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:21:13.697644 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [req-b6fa7dce-eb8d-4d3b-911c-5dac48066126 req-d205df7e-7ddf-4c78-9d9d-92f3a5d2e865 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24ad6e3e-6043-4eff-afb4-0c6039e825fa", "tag": "3807af14-6f9a-4bcc-86d0-c9961d4697ae"}]} {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:21:13.716267 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [req-b6fa7dce-eb8d-4d3b-911c-5dac48066126 req-d205df7e-7ddf-4c78-9d9d-92f3a5d2e865 service nova] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:13.716864 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [req-b6fa7dce-eb8d-4d3b-911c-5dac48066126 req-d205df7e-7ddf-4c78-9d9d-92f3a5d2e865 service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:13.717428 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [req-b6fa7dce-eb8d-4d3b-911c-5dac48066126 req-d205df7e-7ddf-4c78-9d9d-92f3a5d2e865 service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:13.735802 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.compute.server_external_events [req-b6fa7dce-eb8d-4d3b-911c-5dac48066126 req-d205df7e-7ddf-4c78-9d9d-92f3a5d2e865 service nova] Creating event network-changed:3807af14-6f9a-4bcc-86d0-c9961d4697ae for instance 24ad6e3e-6043-4eff-afb4-0c6039e825fa on hv-cinder-86309 Oct 31 19:21:13.744234 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [req-b6fa7dce-eb8d-4d3b-911c-5dac48066126 req-d205df7e-7ddf-4c78-9d9d-92f3a5d2e865 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.201097 Oct 31 19:21:13.745983 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 31/58] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 31 19:21:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:21:13.754796 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-55767471-57df-45d5-9c36-72ce14e3b838 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:21:13.756451 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-55767471-57df-45d5-9c36-72ce14e3b838 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 24ad6e3e-6043-4eff-afb4-0c6039e825fa] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:21:13.807702 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-55767471-57df-45d5-9c36-72ce14e3b838 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:13.808523 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-55767471-57df-45d5-9c36-72ce14e3b838 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:13.809415 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-55767471-57df-45d5-9c36-72ce14e3b838 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:13.810485 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-55767471-57df-45d5-9c36-72ce14e3b838 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:13.811594 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-55767471-57df-45d5-9c36-72ce14e3b838 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:13.812254 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-55767471-57df-45d5-9c36-72ce14e3b838 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:14.191525 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-55767471-57df-45d5-9c36-72ce14e3b838 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:21:14.209688 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-55767471-57df-45d5-9c36-72ce14e3b838 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:21:14.211246 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-55767471-57df-45d5-9c36-72ce14e3b838 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:21:14.215424 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-55767471-57df-45d5-9c36-72ce14e3b838 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa" status: 200 len: 1407 microversion: 2.20 time: 0.467571 Oct 31 19:21:14.217935 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 32/59] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 31 19:21:13 2022] GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa => generated 1407 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 19:21:14.235582 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-4cb09237-f1f7-40f7-b213-9b026df37626 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:21:14.236789 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-4cb09237-f1f7-40f7-b213-9b026df37626 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] [instance: 0a122a08-bc0f-40fd-8139-74c9e8a70ebe] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:21:14.265293 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-4cb09237-f1f7-40f7-b213-9b026df37626 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:14.266441 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-4cb09237-f1f7-40f7-b213-9b026df37626 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:14.267082 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-4cb09237-f1f7-40f7-b213-9b026df37626 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:14.269600 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-4cb09237-f1f7-40f7-b213-9b026df37626 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:14.271139 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-4cb09237-f1f7-40f7-b213-9b026df37626 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:14.272362 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-4cb09237-f1f7-40f7-b213-9b026df37626 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:14.342877 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG dbcounter [-] [118727] Writing DB stats nova_cell0:SELECT=34 {{(pid=118727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:21:14.506796 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-4cb09237-f1f7-40f7-b213-9b026df37626 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ece6ca9374764214bac6263bd691bc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9c317b548b40deb8cb27236d36d674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:21:14.515399 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-4cb09237-f1f7-40f7-b213-9b026df37626 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] 10.222.0.16 "GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe" status: 200 len: 1362 microversion: 2.1 time: 0.295345 Oct 31 19:21:14.534496 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 33/60] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:21:14 2022] GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe => generated 1362 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:21:14.540235 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-84ba0abc-1c59-4a8d-9ad2-9bd54487199c tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:21:14.547598 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-84ba0abc-1c59-4a8d-9ad2-9bd54487199c tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 37698c73-94da-4904-a8d5-636936092fba] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:21:14.560179 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-84ba0abc-1c59-4a8d-9ad2-9bd54487199c tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:14.561389 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-84ba0abc-1c59-4a8d-9ad2-9bd54487199c tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:14.562070 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-84ba0abc-1c59-4a8d-9ad2-9bd54487199c tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:14.565732 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-84ba0abc-1c59-4a8d-9ad2-9bd54487199c tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:14.565732 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-84ba0abc-1c59-4a8d-9ad2-9bd54487199c tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:14.565732 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-84ba0abc-1c59-4a8d-9ad2-9bd54487199c tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:15.063633 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-e69a4209-11bc-4e30-9d8e-9075660d9818 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af27927be0e249bfb320652152f501bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c549a25d33441e98aae78e940a69c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:21:15.068163 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG dbcounter [-] [118727] Writing DB stats nova_cell1:SELECT=65 {{(pid=118727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:21:15.075551 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-e69a4209-11bc-4e30-9d8e-9075660d9818 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] 10.222.0.16 "GET /compute/v2.1/servers/98a9a544-4553-4083-aa26-1dc327369d54" status: 200 len: 1314 microversion: 2.1 time: 1.691323 Oct 31 19:21:15.076468 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 28/61] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:21:13 2022] GET /compute/v2.1/servers/98a9a544-4553-4083-aa26-1dc327369d54 => generated 1314 bytes in 1695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:21:15.246702 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-40de2bd5-e8f4-4746-99ce-fa0c4dd6d824 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:21:15.247679 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-40de2bd5-e8f4-4746-99ce-fa0c4dd6d824 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 24ad6e3e-6043-4eff-afb4-0c6039e825fa] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:21:15.258483 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-40de2bd5-e8f4-4746-99ce-fa0c4dd6d824 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:15.260136 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-40de2bd5-e8f4-4746-99ce-fa0c4dd6d824 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:15.261869 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-40de2bd5-e8f4-4746-99ce-fa0c4dd6d824 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:15.263448 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-40de2bd5-e8f4-4746-99ce-fa0c4dd6d824 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:15.266195 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-40de2bd5-e8f4-4746-99ce-fa0c4dd6d824 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:15.267101 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-40de2bd5-e8f4-4746-99ce-fa0c4dd6d824 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:15.328644 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-84ba0abc-1c59-4a8d-9ad2-9bd54487199c tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc49f9eb3114759b2889ed8972136d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cf63c76fc543428404002ae9a75b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:21:15.341118 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-84ba0abc-1c59-4a8d-9ad2-9bd54487199c tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/37698c73-94da-4904-a8d5-636936092fba" status: 200 len: 1321 microversion: 2.1 time: 0.805070 Oct 31 19:21:15.342227 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 34/62] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:21:14 2022] GET /compute/v2.1/servers/37698c73-94da-4904-a8d5-636936092fba => generated 1321 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:21:15.540667 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-ee8a9500-66b4-4369-8a3b-a6146c0369a2 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:21:15.541386 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-ee8a9500-66b4-4369-8a3b-a6146c0369a2 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] [instance: 0a122a08-bc0f-40fd-8139-74c9e8a70ebe] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:21:15.564558 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-ee8a9500-66b4-4369-8a3b-a6146c0369a2 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:15.579668 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-ee8a9500-66b4-4369-8a3b-a6146c0369a2 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:15.581263 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-ee8a9500-66b4-4369-8a3b-a6146c0369a2 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:15.582157 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-ee8a9500-66b4-4369-8a3b-a6146c0369a2 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:15.583766 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-ee8a9500-66b4-4369-8a3b-a6146c0369a2 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:15.585259 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-ee8a9500-66b4-4369-8a3b-a6146c0369a2 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:15.854645 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-40de2bd5-e8f4-4746-99ce-fa0c4dd6d824 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:21:15.867963 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-40de2bd5-e8f4-4746-99ce-fa0c4dd6d824 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:21:15.869671 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-40de2bd5-e8f4-4746-99ce-fa0c4dd6d824 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:21:15.872454 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-40de2bd5-e8f4-4746-99ce-fa0c4dd6d824 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa" status: 200 len: 1407 microversion: 2.20 time: 0.630281 Oct 31 19:21:15.873514 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 29/63] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 31 19:21:15 2022] GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa => generated 1407 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 19:21:15.890877 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [req-9e2e03be-f7a9-4cce-9556-bd85e2b35fa3 req-c214ddec-0cf9-49a0-8dd0-a30a9684afc8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a47cd33-e4a0-4b78-9afc-2f371e4a9d10", "tag": "c1f5b141-b428-4cbf-9938-2df49ece4368"}]} {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:21:15.939092 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [req-9e2e03be-f7a9-4cce-9556-bd85e2b35fa3 req-c214ddec-0cf9-49a0-8dd0-a30a9684afc8 service nova] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:15.940550 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [req-9e2e03be-f7a9-4cce-9556-bd85e2b35fa3 req-c214ddec-0cf9-49a0-8dd0-a30a9684afc8 service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:15.941265 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [req-9e2e03be-f7a9-4cce-9556-bd85e2b35fa3 req-c214ddec-0cf9-49a0-8dd0-a30a9684afc8 service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:15.966877 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.compute.server_external_events [req-9e2e03be-f7a9-4cce-9556-bd85e2b35fa3 req-c214ddec-0cf9-49a0-8dd0-a30a9684afc8 service nova] Creating event network-changed:c1f5b141-b428-4cbf-9938-2df49ece4368 for instance 7a47cd33-e4a0-4b78-9afc-2f371e4a9d10 on hv-cinder-86309 Oct 31 19:21:15.967901 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [req-9e2e03be-f7a9-4cce-9556-bd85e2b35fa3 req-c214ddec-0cf9-49a0-8dd0-a30a9684afc8 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=118727) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 31 19:21:15.969030 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [req-9e2e03be-f7a9-4cce-9556-bd85e2b35fa3 req-c214ddec-0cf9-49a0-8dd0-a30a9684afc8 service nova] Acquired lock "compute-rpcapi-router" {{(pid=118727) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 31 19:21:15.970384 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-ac8ff123-0d8f-4c94-b33c-a49f27e06e4b None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:15.971051 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-ac8ff123-0d8f-4c94-b33c-a49f27e06e4b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:15.972349 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-ac8ff123-0d8f-4c94-b33c-a49f27e06e4b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:15.973678 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-ac8ff123-0d8f-4c94-b33c-a49f27e06e4b None None] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:15.974463 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-ac8ff123-0d8f-4c94-b33c-a49f27e06e4b None None] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:15.975487 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-ac8ff123-0d8f-4c94-b33c-a49f27e06e4b None None] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:15.995202 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.compute.rpcapi [None req-ac8ff123-0d8f-4c94-b33c-a49f27e06e4b None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 31 19:21:15.996599 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-ac8ff123-0d8f-4c94-b33c-a49f27e06e4b None None] Releasing lock "compute-rpcapi-router" {{(pid=118727) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 31 19:21:16.023227 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-ac8ff123-0d8f-4c94-b33c-a49f27e06e4b None None] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.148044 Oct 31 19:21:16.025145 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 30/64] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 31 19:21:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:21:16.033524 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [req-d29cadc8-3685-4bac-bd26-003cae68a4c6 req-3c7ca800-09a3-442a-b923-c086b6e43260 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98a9a544-4553-4083-aa26-1dc327369d54", "tag": "c411fd72-ddd2-4429-98b0-69e862f32b98"}]} {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:21:16.053921 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [req-d29cadc8-3685-4bac-bd26-003cae68a4c6 req-3c7ca800-09a3-442a-b923-c086b6e43260 service nova] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:16.054639 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [req-d29cadc8-3685-4bac-bd26-003cae68a4c6 req-3c7ca800-09a3-442a-b923-c086b6e43260 service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:16.055550 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [req-d29cadc8-3685-4bac-bd26-003cae68a4c6 req-3c7ca800-09a3-442a-b923-c086b6e43260 service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:16.072832 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.compute.server_external_events [req-d29cadc8-3685-4bac-bd26-003cae68a4c6 req-3c7ca800-09a3-442a-b923-c086b6e43260 service nova] Creating event network-changed:c411fd72-ddd2-4429-98b0-69e862f32b98 for instance 98a9a544-4553-4083-aa26-1dc327369d54 on hv-cinder-86309 Oct 31 19:21:16.086850 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [req-d29cadc8-3685-4bac-bd26-003cae68a4c6 req-3c7ca800-09a3-442a-b923-c086b6e43260 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055549 Oct 31 19:21:16.087878 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 31/65] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 31 19:21:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:21:16.107138 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-9b7c747b-3a5e-4d2f-993e-e9aaa9b784fd tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:21:16.108153 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-9b7c747b-3a5e-4d2f-993e-e9aaa9b784fd tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] [instance: 98a9a544-4553-4083-aa26-1dc327369d54] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:21:16.119274 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-9b7c747b-3a5e-4d2f-993e-e9aaa9b784fd tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:16.119895 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-9b7c747b-3a5e-4d2f-993e-e9aaa9b784fd tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:16.120594 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-9b7c747b-3a5e-4d2f-993e-e9aaa9b784fd tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:16.124308 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-9b7c747b-3a5e-4d2f-993e-e9aaa9b784fd tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:16.124788 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-9b7c747b-3a5e-4d2f-993e-e9aaa9b784fd tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:16.125231 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-9b7c747b-3a5e-4d2f-993e-e9aaa9b784fd tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:16.156175 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-ee8a9500-66b4-4369-8a3b-a6146c0369a2 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ece6ca9374764214bac6263bd691bc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9c317b548b40deb8cb27236d36d674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:21:16.165765 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-ee8a9500-66b4-4369-8a3b-a6146c0369a2 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] 10.222.0.16 "GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe" status: 200 len: 1362 microversion: 2.1 time: 0.628783 Oct 31 19:21:16.183867 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 35/66] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:21:15 2022] GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe => generated 1362 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 19:21:16.368721 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-02b9355b-bd33-4ef7-8305-1b1e5a75c537 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:21:16.369767 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-02b9355b-bd33-4ef7-8305-1b1e5a75c537 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 37698c73-94da-4904-a8d5-636936092fba] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:21:16.378653 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-02b9355b-bd33-4ef7-8305-1b1e5a75c537 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:16.379150 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-02b9355b-bd33-4ef7-8305-1b1e5a75c537 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:16.387426 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-02b9355b-bd33-4ef7-8305-1b1e5a75c537 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:16.388309 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-02b9355b-bd33-4ef7-8305-1b1e5a75c537 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:16.388787 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-02b9355b-bd33-4ef7-8305-1b1e5a75c537 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:16.389227 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-02b9355b-bd33-4ef7-8305-1b1e5a75c537 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:16.389519 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-9b7c747b-3a5e-4d2f-993e-e9aaa9b784fd tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af27927be0e249bfb320652152f501bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c549a25d33441e98aae78e940a69c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:21:16.404188 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-9b7c747b-3a5e-4d2f-993e-e9aaa9b784fd tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] 10.222.0.16 "GET /compute/v2.1/servers/98a9a544-4553-4083-aa26-1dc327369d54" status: 200 len: 1314 microversion: 2.1 time: 0.304563 Oct 31 19:21:16.409638 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 32/67] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:21:16 2022] GET /compute/v2.1/servers/98a9a544-4553-4083-aa26-1dc327369d54 => generated 1314 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 19:21:16.891614 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-02b9355b-bd33-4ef7-8305-1b1e5a75c537 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc49f9eb3114759b2889ed8972136d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cf63c76fc543428404002ae9a75b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:21:16.905519 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-50d78c52-9037-4eed-86c8-2611b1bd8130 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:21:16.906138 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-02b9355b-bd33-4ef7-8305-1b1e5a75c537 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/37698c73-94da-4904-a8d5-636936092fba" status: 200 len: 1321 microversion: 2.1 time: 0.540831 Oct 31 19:21:16.907655 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-50d78c52-9037-4eed-86c8-2611b1bd8130 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 24ad6e3e-6043-4eff-afb4-0c6039e825fa] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:21:16.914278 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-50d78c52-9037-4eed-86c8-2611b1bd8130 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:16.914894 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-50d78c52-9037-4eed-86c8-2611b1bd8130 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:16.915465 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-50d78c52-9037-4eed-86c8-2611b1bd8130 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:16.916305 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-50d78c52-9037-4eed-86c8-2611b1bd8130 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:16.917123 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-50d78c52-9037-4eed-86c8-2611b1bd8130 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:16.917809 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-50d78c52-9037-4eed-86c8-2611b1bd8130 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:16.919636 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 36/68] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:21:16 2022] GET /compute/v2.1/servers/37698c73-94da-4904-a8d5-636936092fba => generated 1321 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:21:17.101182 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-50d78c52-9037-4eed-86c8-2611b1bd8130 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:21:17.113135 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-50d78c52-9037-4eed-86c8-2611b1bd8130 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:21:17.115996 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-50d78c52-9037-4eed-86c8-2611b1bd8130 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:21:17.117972 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-50d78c52-9037-4eed-86c8-2611b1bd8130 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa" status: 200 len: 1407 microversion: 2.20 time: 0.218611 Oct 31 19:21:17.119724 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 33/69] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 31 19:21:16 2022] GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa => generated 1407 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 19:21:17.200807 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-c6e0c225-893b-47a8-b36f-fb134fecd4d2 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:21:17.201766 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-c6e0c225-893b-47a8-b36f-fb134fecd4d2 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] [instance: 0a122a08-bc0f-40fd-8139-74c9e8a70ebe] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:21:17.208477 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-c6e0c225-893b-47a8-b36f-fb134fecd4d2 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:17.208964 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-c6e0c225-893b-47a8-b36f-fb134fecd4d2 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:17.209627 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-c6e0c225-893b-47a8-b36f-fb134fecd4d2 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:17.211259 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-c6e0c225-893b-47a8-b36f-fb134fecd4d2 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:17.211931 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-c6e0c225-893b-47a8-b36f-fb134fecd4d2 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:17.212552 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-c6e0c225-893b-47a8-b36f-fb134fecd4d2 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:17.434016 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-69416a38-3fa4-4a5e-b591-6a5d1182eed6 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:21:17.434646 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-69416a38-3fa4-4a5e-b591-6a5d1182eed6 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] [instance: 98a9a544-4553-4083-aa26-1dc327369d54] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:21:17.441430 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-69416a38-3fa4-4a5e-b591-6a5d1182eed6 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:17.446364 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-69416a38-3fa4-4a5e-b591-6a5d1182eed6 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:17.448675 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-69416a38-3fa4-4a5e-b591-6a5d1182eed6 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:17.449887 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-69416a38-3fa4-4a5e-b591-6a5d1182eed6 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:17.450131 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-c6e0c225-893b-47a8-b36f-fb134fecd4d2 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ece6ca9374764214bac6263bd691bc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9c317b548b40deb8cb27236d36d674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:21:17.452363 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-69416a38-3fa4-4a5e-b591-6a5d1182eed6 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:17.454518 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-69416a38-3fa4-4a5e-b591-6a5d1182eed6 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:17.460835 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-c6e0c225-893b-47a8-b36f-fb134fecd4d2 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] 10.222.0.16 "GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe" status: 200 len: 1362 microversion: 2.1 time: 0.261281 Oct 31 19:21:17.461997 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 37/70] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:21:17 2022] GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe => generated 1362 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:21:17.659738 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-69416a38-3fa4-4a5e-b591-6a5d1182eed6 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af27927be0e249bfb320652152f501bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c549a25d33441e98aae78e940a69c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:21:17.672285 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-69416a38-3fa4-4a5e-b591-6a5d1182eed6 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] 10.222.0.16 "GET /compute/v2.1/servers/98a9a544-4553-4083-aa26-1dc327369d54" status: 200 len: 1314 microversion: 2.1 time: 0.243170 Oct 31 19:21:17.673511 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 34/71] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:21:17 2022] GET /compute/v2.1/servers/98a9a544-4553-4083-aa26-1dc327369d54 => generated 1314 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:21:17.939093 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-70cfb866-ba7f-4ad7-b8e8-3c4792961be5 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:21:17.939878 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-70cfb866-ba7f-4ad7-b8e8-3c4792961be5 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 37698c73-94da-4904-a8d5-636936092fba] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:21:17.956773 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG dbcounter [-] [118726] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=6 {{(pid=118726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:21:17.963074 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-70cfb866-ba7f-4ad7-b8e8-3c4792961be5 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:17.963581 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-70cfb866-ba7f-4ad7-b8e8-3c4792961be5 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:17.964014 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-70cfb866-ba7f-4ad7-b8e8-3c4792961be5 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:17.964712 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-70cfb866-ba7f-4ad7-b8e8-3c4792961be5 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:17.969957 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-70cfb866-ba7f-4ad7-b8e8-3c4792961be5 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:17.970662 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-70cfb866-ba7f-4ad7-b8e8-3c4792961be5 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:18.126808 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [req-a373832f-24c1-4f1f-bfb7-d5682a04b117 req-85c2bc91-d570-4ef3-b3ea-0c63f8a81d42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a122a08-bc0f-40fd-8139-74c9e8a70ebe", "tag": "810ffdd3-13de-43d5-a09c-221911cc3bcf"}]} {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:21:18.149300 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [req-a373832f-24c1-4f1f-bfb7-d5682a04b117 req-85c2bc91-d570-4ef3-b3ea-0c63f8a81d42 service nova] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:18.149810 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [req-a373832f-24c1-4f1f-bfb7-d5682a04b117 req-85c2bc91-d570-4ef3-b3ea-0c63f8a81d42 service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:18.150236 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [req-a373832f-24c1-4f1f-bfb7-d5682a04b117 req-85c2bc91-d570-4ef3-b3ea-0c63f8a81d42 service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:18.173283 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.compute.server_external_events [req-a373832f-24c1-4f1f-bfb7-d5682a04b117 req-85c2bc91-d570-4ef3-b3ea-0c63f8a81d42 service nova] Creating event network-changed:810ffdd3-13de-43d5-a09c-221911cc3bcf for instance 0a122a08-bc0f-40fd-8139-74c9e8a70ebe on hv-cinder-86309 Oct 31 19:21:18.185245 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [req-a373832f-24c1-4f1f-bfb7-d5682a04b117 req-85c2bc91-d570-4ef3-b3ea-0c63f8a81d42 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062296 Oct 31 19:21:18.190644 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 35/72] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 31 19:21:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:21:18.196112 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-2bfcc313-503d-40fc-8b75-523fe3aacbad tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:21:18.196795 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-2bfcc313-503d-40fc-8b75-523fe3aacbad tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 24ad6e3e-6043-4eff-afb4-0c6039e825fa] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:21:18.218698 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-2bfcc313-503d-40fc-8b75-523fe3aacbad tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:18.219183 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-2bfcc313-503d-40fc-8b75-523fe3aacbad tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:18.219688 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-2bfcc313-503d-40fc-8b75-523fe3aacbad tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:18.220480 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-2bfcc313-503d-40fc-8b75-523fe3aacbad tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:18.221202 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-2bfcc313-503d-40fc-8b75-523fe3aacbad tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:18.221837 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-2bfcc313-503d-40fc-8b75-523fe3aacbad tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:18.464903 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-70cfb866-ba7f-4ad7-b8e8-3c4792961be5 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc49f9eb3114759b2889ed8972136d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cf63c76fc543428404002ae9a75b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:21:18.475929 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-70cfb866-ba7f-4ad7-b8e8-3c4792961be5 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/37698c73-94da-4904-a8d5-636936092fba" status: 200 len: 1321 microversion: 2.1 time: 0.548138 Oct 31 19:21:18.492122 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 38/73] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:21:17 2022] GET /compute/v2.1/servers/37698c73-94da-4904-a8d5-636936092fba => generated 1321 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:21:18.503051 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-7855af45-1472-417c-8cd8-6c2d9299ecc0 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:21:18.503915 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-7855af45-1472-417c-8cd8-6c2d9299ecc0 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] [instance: 0a122a08-bc0f-40fd-8139-74c9e8a70ebe] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:21:18.514827 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-7855af45-1472-417c-8cd8-6c2d9299ecc0 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:18.515954 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-7855af45-1472-417c-8cd8-6c2d9299ecc0 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:18.517087 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-7855af45-1472-417c-8cd8-6c2d9299ecc0 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:18.519177 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-7855af45-1472-417c-8cd8-6c2d9299ecc0 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:18.521227 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-7855af45-1472-417c-8cd8-6c2d9299ecc0 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:18.522335 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-7855af45-1472-417c-8cd8-6c2d9299ecc0 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:18.861351 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-7855af45-1472-417c-8cd8-6c2d9299ecc0 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ece6ca9374764214bac6263bd691bc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9c317b548b40deb8cb27236d36d674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:21:18.874027 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-7855af45-1472-417c-8cd8-6c2d9299ecc0 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] 10.222.0.16 "GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe" status: 200 len: 1362 microversion: 2.1 time: 0.379887 Oct 31 19:21:18.879166 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 39/74] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:21:18 2022] GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe => generated 1362 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:21:18.910575 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-3f429cbe-0534-4ad5-a7a4-bfc0478fd42b tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:21:18.911130 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-3f429cbe-0534-4ad5-a7a4-bfc0478fd42b tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] [instance: 98a9a544-4553-4083-aa26-1dc327369d54] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:21:18.935525 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-3f429cbe-0534-4ad5-a7a4-bfc0478fd42b tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:18.935992 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-3f429cbe-0534-4ad5-a7a4-bfc0478fd42b tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:18.936430 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-3f429cbe-0534-4ad5-a7a4-bfc0478fd42b tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:18.937164 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-3f429cbe-0534-4ad5-a7a4-bfc0478fd42b tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:18.937626 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-3f429cbe-0534-4ad5-a7a4-bfc0478fd42b tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:18.938078 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-3f429cbe-0534-4ad5-a7a4-bfc0478fd42b tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:19.122088 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-2bfcc313-503d-40fc-8b75-523fe3aacbad tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:21:19.154385 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-2bfcc313-503d-40fc-8b75-523fe3aacbad tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:21:19.159109 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-2bfcc313-503d-40fc-8b75-523fe3aacbad tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:21:19.160493 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-2bfcc313-503d-40fc-8b75-523fe3aacbad tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa" status: 200 len: 1407 microversion: 2.20 time: 0.968672 Oct 31 19:21:19.164299 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 36/75] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 31 19:21:18 2022] GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa => generated 1407 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 19:21:19.506345 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-0fc6ca07-5719-4296-b58e-b669bc7a6751 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:21:19.507171 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-0fc6ca07-5719-4296-b58e-b669bc7a6751 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 37698c73-94da-4904-a8d5-636936092fba] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:21:19.529333 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-0fc6ca07-5719-4296-b58e-b669bc7a6751 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:19.531382 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-0fc6ca07-5719-4296-b58e-b669bc7a6751 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:19.533473 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-0fc6ca07-5719-4296-b58e-b669bc7a6751 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:19.539232 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-0fc6ca07-5719-4296-b58e-b669bc7a6751 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:19.542166 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-0fc6ca07-5719-4296-b58e-b669bc7a6751 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:19.543999 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-3f429cbe-0534-4ad5-a7a4-bfc0478fd42b tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af27927be0e249bfb320652152f501bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c549a25d33441e98aae78e940a69c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:21:19.544713 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-0fc6ca07-5719-4296-b58e-b669bc7a6751 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:19.555289 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-3f429cbe-0534-4ad5-a7a4-bfc0478fd42b tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] 10.222.0.16 "GET /compute/v2.1/servers/98a9a544-4553-4083-aa26-1dc327369d54" status: 200 len: 1314 microversion: 2.1 time: 0.664240 Oct 31 19:21:19.555876 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 40/76] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:21:18 2022] GET /compute/v2.1/servers/98a9a544-4553-4083-aa26-1dc327369d54 => generated 1314 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:21:19.905962 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-42cfdf39-315d-4da2-8875-202a686bf0c2 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:21:19.906748 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-42cfdf39-315d-4da2-8875-202a686bf0c2 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] [instance: 0a122a08-bc0f-40fd-8139-74c9e8a70ebe] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:21:19.917183 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-42cfdf39-315d-4da2-8875-202a686bf0c2 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:19.917724 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-42cfdf39-315d-4da2-8875-202a686bf0c2 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:19.918167 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-42cfdf39-315d-4da2-8875-202a686bf0c2 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:19.918877 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-42cfdf39-315d-4da2-8875-202a686bf0c2 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:19.919360 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-42cfdf39-315d-4da2-8875-202a686bf0c2 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:19.919782 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-42cfdf39-315d-4da2-8875-202a686bf0c2 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:20.026722 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-0fc6ca07-5719-4296-b58e-b669bc7a6751 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc49f9eb3114759b2889ed8972136d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cf63c76fc543428404002ae9a75b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:21:20.039835 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-0fc6ca07-5719-4296-b58e-b669bc7a6751 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/37698c73-94da-4904-a8d5-636936092fba" status: 200 len: 1321 microversion: 2.1 time: 0.538888 Oct 31 19:21:20.040753 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 37/77] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:21:19 2022] GET /compute/v2.1/servers/37698c73-94da-4904-a8d5-636936092fba => generated 1321 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:21:20.190487 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-558f5fbc-20fa-42f1-bd98-875a1e034e63 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:21:20.191117 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-558f5fbc-20fa-42f1-bd98-875a1e034e63 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 24ad6e3e-6043-4eff-afb4-0c6039e825fa] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:21:20.202866 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-42cfdf39-315d-4da2-8875-202a686bf0c2 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ece6ca9374764214bac6263bd691bc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9c317b548b40deb8cb27236d36d674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:21:20.203067 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-558f5fbc-20fa-42f1-bd98-875a1e034e63 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:20.203446 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-558f5fbc-20fa-42f1-bd98-875a1e034e63 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:20.203888 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-558f5fbc-20fa-42f1-bd98-875a1e034e63 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:20.204582 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-558f5fbc-20fa-42f1-bd98-875a1e034e63 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:20.205152 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-558f5fbc-20fa-42f1-bd98-875a1e034e63 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:20.205458 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-558f5fbc-20fa-42f1-bd98-875a1e034e63 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:20.212286 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-42cfdf39-315d-4da2-8875-202a686bf0c2 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] 10.222.0.16 "GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe" status: 200 len: 1362 microversion: 2.1 time: 0.311344 Oct 31 19:21:20.213407 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 41/78] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:21:19 2022] GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe => generated 1362 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:21:20.467466 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-558f5fbc-20fa-42f1-bd98-875a1e034e63 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:21:20.492225 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-558f5fbc-20fa-42f1-bd98-875a1e034e63 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:21:20.494049 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-558f5fbc-20fa-42f1-bd98-875a1e034e63 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:21:20.496963 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-558f5fbc-20fa-42f1-bd98-875a1e034e63 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa" status: 200 len: 1407 microversion: 2.20 time: 0.310265 Oct 31 19:21:20.501516 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 38/79] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 31 19:21:20 2022] GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa => generated 1407 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 19:21:20.577767 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-42253cd4-d0b1-45ac-adb4-1a6db8b5dffa tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:21:20.578461 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-42253cd4-d0b1-45ac-adb4-1a6db8b5dffa tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] [instance: 98a9a544-4553-4083-aa26-1dc327369d54] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:21:20.585303 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-42253cd4-d0b1-45ac-adb4-1a6db8b5dffa tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:20.587897 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-42253cd4-d0b1-45ac-adb4-1a6db8b5dffa tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:20.592199 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-42253cd4-d0b1-45ac-adb4-1a6db8b5dffa tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:20.595562 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-42253cd4-d0b1-45ac-adb4-1a6db8b5dffa tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:20.597781 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-42253cd4-d0b1-45ac-adb4-1a6db8b5dffa tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:20.601012 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-42253cd4-d0b1-45ac-adb4-1a6db8b5dffa tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:21.064754 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-21137306-f5d6-475e-b625-bdf65494a438 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:21:21.065452 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-21137306-f5d6-475e-b625-bdf65494a438 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 37698c73-94da-4904-a8d5-636936092fba] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:21:21.071964 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-21137306-f5d6-475e-b625-bdf65494a438 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:21.072459 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-21137306-f5d6-475e-b625-bdf65494a438 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:21.072896 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-21137306-f5d6-475e-b625-bdf65494a438 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:21.085013 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-21137306-f5d6-475e-b625-bdf65494a438 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:21.088682 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-21137306-f5d6-475e-b625-bdf65494a438 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:21.089951 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-21137306-f5d6-475e-b625-bdf65494a438 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:21.305213 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-42253cd4-d0b1-45ac-adb4-1a6db8b5dffa tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af27927be0e249bfb320652152f501bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c549a25d33441e98aae78e940a69c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:21:21.318297 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-42253cd4-d0b1-45ac-adb4-1a6db8b5dffa tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] 10.222.0.16 "GET /compute/v2.1/servers/98a9a544-4553-4083-aa26-1dc327369d54" status: 200 len: 1314 microversion: 2.1 time: 0.744082 Oct 31 19:21:21.323318 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 42/80] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:21:20 2022] GET /compute/v2.1/servers/98a9a544-4553-4083-aa26-1dc327369d54 => generated 1314 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:21:21.343995 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-3b400721-1cda-4485-a864-8f60329ad9ea tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:21:21.344897 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-3b400721-1cda-4485-a864-8f60329ad9ea tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] [instance: 0a122a08-bc0f-40fd-8139-74c9e8a70ebe] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:21:21.359800 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-3b400721-1cda-4485-a864-8f60329ad9ea tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:21.363353 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-3b400721-1cda-4485-a864-8f60329ad9ea tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:21.364138 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-3b400721-1cda-4485-a864-8f60329ad9ea tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:21.366877 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-3b400721-1cda-4485-a864-8f60329ad9ea tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:21.367459 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-3b400721-1cda-4485-a864-8f60329ad9ea tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:21.369744 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-3b400721-1cda-4485-a864-8f60329ad9ea tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:21.698013 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-3b400721-1cda-4485-a864-8f60329ad9ea tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ece6ca9374764214bac6263bd691bc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9c317b548b40deb8cb27236d36d674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:21:21.708058 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-3b400721-1cda-4485-a864-8f60329ad9ea tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] 10.222.0.16 "GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe" status: 200 len: 1362 microversion: 2.1 time: 0.381813 Oct 31 19:21:21.710367 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 43/81] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:21:21 2022] GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe => generated 1362 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:21:21.720401 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-1df16a72-3a2e-4c5d-ae96-170f50234149 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:21:21.722786 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-1df16a72-3a2e-4c5d-ae96-170f50234149 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 24ad6e3e-6043-4eff-afb4-0c6039e825fa] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:21:21.735911 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-1df16a72-3a2e-4c5d-ae96-170f50234149 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:21.742403 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-1df16a72-3a2e-4c5d-ae96-170f50234149 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:21.743223 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-1df16a72-3a2e-4c5d-ae96-170f50234149 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:21.744599 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-1df16a72-3a2e-4c5d-ae96-170f50234149 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:21.746520 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-1df16a72-3a2e-4c5d-ae96-170f50234149 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:21.749433 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-1df16a72-3a2e-4c5d-ae96-170f50234149 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:21.784962 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-21137306-f5d6-475e-b625-bdf65494a438 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc49f9eb3114759b2889ed8972136d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cf63c76fc543428404002ae9a75b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:21:21.797645 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-21137306-f5d6-475e-b625-bdf65494a438 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/37698c73-94da-4904-a8d5-636936092fba" status: 200 len: 1321 microversion: 2.1 time: 0.737467 Oct 31 19:21:21.814908 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 39/82] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:21:21 2022] GET /compute/v2.1/servers/37698c73-94da-4904-a8d5-636936092fba => generated 1321 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:21:22.197041 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [req-a8d8b672-fb8e-4faa-a680-8790f4ad3cc1 req-10d1d241-c0b1-4c8a-a27b-a09806b2d22d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24ad6e3e-6043-4eff-afb4-0c6039e825fa", "name": "network-vif-plugged", "status": "completed", "tag": "3807af14-6f9a-4bcc-86d0-c9961d4697ae"}]} {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:21:22.216011 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [req-a8d8b672-fb8e-4faa-a680-8790f4ad3cc1 req-10d1d241-c0b1-4c8a-a27b-a09806b2d22d service nova] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:22.216572 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [req-a8d8b672-fb8e-4faa-a680-8790f4ad3cc1 req-10d1d241-c0b1-4c8a-a27b-a09806b2d22d service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:22.217066 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [req-a8d8b672-fb8e-4faa-a680-8790f4ad3cc1 req-10d1d241-c0b1-4c8a-a27b-a09806b2d22d service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:22.241527 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.compute.server_external_events [req-a8d8b672-fb8e-4faa-a680-8790f4ad3cc1 req-10d1d241-c0b1-4c8a-a27b-a09806b2d22d service nova] Creating event network-vif-plugged:3807af14-6f9a-4bcc-86d0-c9961d4697ae for instance 24ad6e3e-6043-4eff-afb4-0c6039e825fa on hv-cinder-86309 Oct 31 19:21:22.259416 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [req-a8d8b672-fb8e-4faa-a680-8790f4ad3cc1 req-10d1d241-c0b1-4c8a-a27b-a09806b2d22d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.442952 Oct 31 19:21:22.260302 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 40/83] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 31 19:21:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:21:22.306365 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-1df16a72-3a2e-4c5d-ae96-170f50234149 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:21:22.317708 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-1df16a72-3a2e-4c5d-ae96-170f50234149 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:21:22.320340 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-1df16a72-3a2e-4c5d-ae96-170f50234149 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:21:22.321537 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-1df16a72-3a2e-4c5d-ae96-170f50234149 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa" status: 200 len: 1407 microversion: 2.20 time: 0.604992 Oct 31 19:21:22.337641 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 44/84] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 31 19:21:21 2022] GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa => generated 1407 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 19:21:22.351131 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-b6c6e803-af85-4e95-9f6e-4594d27aa42f tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:21:22.351929 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-b6c6e803-af85-4e95-9f6e-4594d27aa42f tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] [instance: 98a9a544-4553-4083-aa26-1dc327369d54] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:21:22.367596 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-b6c6e803-af85-4e95-9f6e-4594d27aa42f tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:22.368388 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-b6c6e803-af85-4e95-9f6e-4594d27aa42f tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:22.369037 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-b6c6e803-af85-4e95-9f6e-4594d27aa42f tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:22.372729 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-b6c6e803-af85-4e95-9f6e-4594d27aa42f tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:22.373537 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-b6c6e803-af85-4e95-9f6e-4594d27aa42f tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:22.374221 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-b6c6e803-af85-4e95-9f6e-4594d27aa42f tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:22.653078 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-b6c6e803-af85-4e95-9f6e-4594d27aa42f tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af27927be0e249bfb320652152f501bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c549a25d33441e98aae78e940a69c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:21:22.666313 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-b6c6e803-af85-4e95-9f6e-4594d27aa42f tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] 10.222.0.16 "GET /compute/v2.1/servers/98a9a544-4553-4083-aa26-1dc327369d54" status: 200 len: 1314 microversion: 2.1 time: 0.320577 Oct 31 19:21:22.667216 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 41/85] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:21:22 2022] GET /compute/v2.1/servers/98a9a544-4553-4083-aa26-1dc327369d54 => generated 1314 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:21:22.744977 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-41a0b472-0892-4a5d-9dcf-b3d6b3971479 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:21:22.745593 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-41a0b472-0892-4a5d-9dcf-b3d6b3971479 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] [instance: 0a122a08-bc0f-40fd-8139-74c9e8a70ebe] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:21:22.757237 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-41a0b472-0892-4a5d-9dcf-b3d6b3971479 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:22.758966 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-41a0b472-0892-4a5d-9dcf-b3d6b3971479 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:22.760346 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-41a0b472-0892-4a5d-9dcf-b3d6b3971479 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:22.762711 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-41a0b472-0892-4a5d-9dcf-b3d6b3971479 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:22.763488 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-41a0b472-0892-4a5d-9dcf-b3d6b3971479 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:22.764527 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-41a0b472-0892-4a5d-9dcf-b3d6b3971479 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:22.795897 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG dbcounter [-] [118726] Writing DB stats nova_cell1:SELECT=100 {{(pid=118726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:21:22.828819 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-7e459ba7-9ef5-48d5-8599-817aef39a101 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:21:22.829521 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-7e459ba7-9ef5-48d5-8599-817aef39a101 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 37698c73-94da-4904-a8d5-636936092fba] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:21:22.847484 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-7e459ba7-9ef5-48d5-8599-817aef39a101 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:22.848852 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-7e459ba7-9ef5-48d5-8599-817aef39a101 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:22.849863 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-7e459ba7-9ef5-48d5-8599-817aef39a101 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:22.859097 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-7e459ba7-9ef5-48d5-8599-817aef39a101 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:22.861300 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-7e459ba7-9ef5-48d5-8599-817aef39a101 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:22.864222 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-7e459ba7-9ef5-48d5-8599-817aef39a101 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:23.110233 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-7e459ba7-9ef5-48d5-8599-817aef39a101 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc49f9eb3114759b2889ed8972136d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cf63c76fc543428404002ae9a75b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:21:23.119743 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-7e459ba7-9ef5-48d5-8599-817aef39a101 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/37698c73-94da-4904-a8d5-636936092fba" status: 200 len: 1321 microversion: 2.1 time: 0.295181 Oct 31 19:21:23.120332 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 42/86] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:21:22 2022] GET /compute/v2.1/servers/37698c73-94da-4904-a8d5-636936092fba => generated 1321 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:21:23.127667 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-41a0b472-0892-4a5d-9dcf-b3d6b3971479 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ece6ca9374764214bac6263bd691bc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9c317b548b40deb8cb27236d36d674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:21:23.140513 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-41a0b472-0892-4a5d-9dcf-b3d6b3971479 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] 10.222.0.16 "GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe" status: 200 len: 1362 microversion: 2.1 time: 0.407447 Oct 31 19:21:23.141661 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 45/87] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:21:22 2022] GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe => generated 1362 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:21:23.356183 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-6eb52617-a00e-41db-ac6e-8d08c56352fe tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:21:23.356808 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-6eb52617-a00e-41db-ac6e-8d08c56352fe tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 24ad6e3e-6043-4eff-afb4-0c6039e825fa] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:21:23.368131 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-6eb52617-a00e-41db-ac6e-8d08c56352fe tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:23.368616 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-6eb52617-a00e-41db-ac6e-8d08c56352fe tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:23.369049 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-6eb52617-a00e-41db-ac6e-8d08c56352fe tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:23.369784 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-6eb52617-a00e-41db-ac6e-8d08c56352fe tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:23.370239 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-6eb52617-a00e-41db-ac6e-8d08c56352fe tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:23.370662 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-6eb52617-a00e-41db-ac6e-8d08c56352fe tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:23.533421 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-6eb52617-a00e-41db-ac6e-8d08c56352fe tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:21:23.542726 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-6eb52617-a00e-41db-ac6e-8d08c56352fe tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:21:23.544469 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-6eb52617-a00e-41db-ac6e-8d08c56352fe tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:21:23.546033 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-6eb52617-a00e-41db-ac6e-8d08c56352fe tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa" status: 200 len: 1407 microversion: 2.20 time: 0.194668 Oct 31 19:21:23.547025 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 43/88] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 31 19:21:23 2022] GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa => generated 1407 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 19:21:23.691464 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-de6e471e-0539-4dc1-8298-17fc231c282c tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:21:23.692996 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-de6e471e-0539-4dc1-8298-17fc231c282c tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] [instance: 98a9a544-4553-4083-aa26-1dc327369d54] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:21:23.696067 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG dbcounter [-] [118726] Writing DB stats nova_cell0:SELECT=2 {{(pid=118726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:21:23.700370 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-de6e471e-0539-4dc1-8298-17fc231c282c tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:23.700863 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-de6e471e-0539-4dc1-8298-17fc231c282c tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:23.701295 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-de6e471e-0539-4dc1-8298-17fc231c282c tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:23.702110 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-de6e471e-0539-4dc1-8298-17fc231c282c tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:23.702563 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-de6e471e-0539-4dc1-8298-17fc231c282c tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:23.703012 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-de6e471e-0539-4dc1-8298-17fc231c282c tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:23.877585 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-de6e471e-0539-4dc1-8298-17fc231c282c tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af27927be0e249bfb320652152f501bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c549a25d33441e98aae78e940a69c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:21:23.887607 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-de6e471e-0539-4dc1-8298-17fc231c282c tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] 10.222.0.16 "GET /compute/v2.1/servers/98a9a544-4553-4083-aa26-1dc327369d54" status: 200 len: 1314 microversion: 2.1 time: 0.200523 Oct 31 19:21:23.888658 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 46/89] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:21:23 2022] GET /compute/v2.1/servers/98a9a544-4553-4083-aa26-1dc327369d54 => generated 1314 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 19:21:24.147393 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-7e3ac3e1-b81a-46c2-afed-cbff4882db7a tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:21:24.148845 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-7e3ac3e1-b81a-46c2-afed-cbff4882db7a tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 37698c73-94da-4904-a8d5-636936092fba] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:21:24.164438 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-307a3ad2-b8d0-4131-a0b6-e0db78b4ee0d tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:21:24.165057 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-307a3ad2-b8d0-4131-a0b6-e0db78b4ee0d tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] [instance: 0a122a08-bc0f-40fd-8139-74c9e8a70ebe] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:21:24.170706 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-7e3ac3e1-b81a-46c2-afed-cbff4882db7a tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:24.171205 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-7e3ac3e1-b81a-46c2-afed-cbff4882db7a tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:24.171645 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-7e3ac3e1-b81a-46c2-afed-cbff4882db7a tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:24.172344 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-7e3ac3e1-b81a-46c2-afed-cbff4882db7a tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:24.174520 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-307a3ad2-b8d0-4131-a0b6-e0db78b4ee0d tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:24.180436 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-307a3ad2-b8d0-4131-a0b6-e0db78b4ee0d tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:24.180889 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-307a3ad2-b8d0-4131-a0b6-e0db78b4ee0d tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:24.181624 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-307a3ad2-b8d0-4131-a0b6-e0db78b4ee0d tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:24.182090 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-307a3ad2-b8d0-4131-a0b6-e0db78b4ee0d tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:24.182516 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-307a3ad2-b8d0-4131-a0b6-e0db78b4ee0d tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:24.187284 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-7e3ac3e1-b81a-46c2-afed-cbff4882db7a tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:24.187977 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-7e3ac3e1-b81a-46c2-afed-cbff4882db7a tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:24.508722 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-7e3ac3e1-b81a-46c2-afed-cbff4882db7a tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc49f9eb3114759b2889ed8972136d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cf63c76fc543428404002ae9a75b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:21:24.526102 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-7e3ac3e1-b81a-46c2-afed-cbff4882db7a tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/37698c73-94da-4904-a8d5-636936092fba" status: 200 len: 1321 microversion: 2.1 time: 0.383012 Oct 31 19:21:24.538410 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 44/90] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:21:24 2022] GET /compute/v2.1/servers/37698c73-94da-4904-a8d5-636936092fba => generated 1321 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:21:24.548507 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [req-b953d151-d476-4e7e-8661-41a2fd6b995f req-ca42295c-f99e-4c8c-b8cd-1a7b4185af92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37698c73-94da-4904-a8d5-636936092fba", "name": "network-vif-plugged", "status": "completed", "tag": "ac17eb8a-95b3-4c82-b434-4b9b13313e65"}]} {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:21:24.558929 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [req-b953d151-d476-4e7e-8661-41a2fd6b995f req-ca42295c-f99e-4c8c-b8cd-1a7b4185af92 service nova] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:24.559697 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [req-b953d151-d476-4e7e-8661-41a2fd6b995f req-ca42295c-f99e-4c8c-b8cd-1a7b4185af92 service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:24.560336 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [req-b953d151-d476-4e7e-8661-41a2fd6b995f req-ca42295c-f99e-4c8c-b8cd-1a7b4185af92 service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:24.576706 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-307a3ad2-b8d0-4131-a0b6-e0db78b4ee0d tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ece6ca9374764214bac6263bd691bc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9c317b548b40deb8cb27236d36d674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:21:24.589136 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.compute.server_external_events [req-b953d151-d476-4e7e-8661-41a2fd6b995f req-ca42295c-f99e-4c8c-b8cd-1a7b4185af92 service nova] Creating event network-vif-plugged:ac17eb8a-95b3-4c82-b434-4b9b13313e65 for instance 37698c73-94da-4904-a8d5-636936092fba on hv-cinder-86309 Oct 31 19:21:24.589974 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-307a3ad2-b8d0-4131-a0b6-e0db78b4ee0d tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] 10.222.0.16 "GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe" status: 200 len: 1362 microversion: 2.1 time: 0.429263 Oct 31 19:21:24.590935 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 47/91] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:21:24 2022] GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe => generated 1362 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:21:24.601790 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-834c0529-a8c7-4b63-9e6e-a06557fdc0bf tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:21:24.604288 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-834c0529-a8c7-4b63-9e6e-a06557fdc0bf tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 24ad6e3e-6043-4eff-afb4-0c6039e825fa] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:21:24.610371 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [req-b953d151-d476-4e7e-8661-41a2fd6b995f req-ca42295c-f99e-4c8c-b8cd-1a7b4185af92 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069988 Oct 31 19:21:24.611502 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 45/92] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 31 19:21:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:21:24.635189 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-834c0529-a8c7-4b63-9e6e-a06557fdc0bf tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:24.635910 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-834c0529-a8c7-4b63-9e6e-a06557fdc0bf tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:24.639017 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-834c0529-a8c7-4b63-9e6e-a06557fdc0bf tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:24.640945 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-834c0529-a8c7-4b63-9e6e-a06557fdc0bf tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:24.644336 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-834c0529-a8c7-4b63-9e6e-a06557fdc0bf tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:24.645722 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-834c0529-a8c7-4b63-9e6e-a06557fdc0bf tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:24.928827 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-aa1b115d-5f0d-452d-9b99-ae7464979f42 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:21:24.930518 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-aa1b115d-5f0d-452d-9b99-ae7464979f42 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] [instance: 98a9a544-4553-4083-aa26-1dc327369d54] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:21:24.937193 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-834c0529-a8c7-4b63-9e6e-a06557fdc0bf tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:21:24.949316 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-834c0529-a8c7-4b63-9e6e-a06557fdc0bf tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:21:24.958339 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-aa1b115d-5f0d-452d-9b99-ae7464979f42 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:24.960724 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-834c0529-a8c7-4b63-9e6e-a06557fdc0bf tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:21:24.965558 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-aa1b115d-5f0d-452d-9b99-ae7464979f42 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:24.966516 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-834c0529-a8c7-4b63-9e6e-a06557fdc0bf tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa" status: 200 len: 1407 microversion: 2.20 time: 0.374485 Oct 31 19:21:24.967109 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-aa1b115d-5f0d-452d-9b99-ae7464979f42 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:24.984820 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-aa1b115d-5f0d-452d-9b99-ae7464979f42 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:24.985086 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 48/93] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 31 19:21:24 2022] GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa => generated 1407 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 19:21:24.993679 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-aa1b115d-5f0d-452d-9b99-ae7464979f42 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:24.994156 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-aa1b115d-5f0d-452d-9b99-ae7464979f42 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:25.230698 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-aa1b115d-5f0d-452d-9b99-ae7464979f42 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af27927be0e249bfb320652152f501bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c549a25d33441e98aae78e940a69c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:21:25.238837 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-aa1b115d-5f0d-452d-9b99-ae7464979f42 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] 10.222.0.16 "GET /compute/v2.1/servers/98a9a544-4553-4083-aa26-1dc327369d54" status: 200 len: 1314 microversion: 2.1 time: 0.326796 Oct 31 19:21:25.239407 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 46/94] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:21:24 2022] GET /compute/v2.1/servers/98a9a544-4553-4083-aa26-1dc327369d54 => generated 1314 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 19:21:25.556232 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-edaa1df5-a7db-4dfc-9e1e-2fcdad740f2d tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:21:25.557659 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-edaa1df5-a7db-4dfc-9e1e-2fcdad740f2d tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 37698c73-94da-4904-a8d5-636936092fba] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:21:25.571798 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-edaa1df5-a7db-4dfc-9e1e-2fcdad740f2d tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:25.572414 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-edaa1df5-a7db-4dfc-9e1e-2fcdad740f2d tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:25.572853 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-edaa1df5-a7db-4dfc-9e1e-2fcdad740f2d tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:25.573588 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-edaa1df5-a7db-4dfc-9e1e-2fcdad740f2d tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:25.574073 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-edaa1df5-a7db-4dfc-9e1e-2fcdad740f2d tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:25.574534 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-edaa1df5-a7db-4dfc-9e1e-2fcdad740f2d tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:25.619092 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-7bd0df59-2785-4e8d-9284-87ed3ff9cb0a tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:21:25.619738 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-7bd0df59-2785-4e8d-9284-87ed3ff9cb0a tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] [instance: 0a122a08-bc0f-40fd-8139-74c9e8a70ebe] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:21:25.629064 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-7bd0df59-2785-4e8d-9284-87ed3ff9cb0a tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:25.629622 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-7bd0df59-2785-4e8d-9284-87ed3ff9cb0a tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:25.630439 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-7bd0df59-2785-4e8d-9284-87ed3ff9cb0a tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:25.631387 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-7bd0df59-2785-4e8d-9284-87ed3ff9cb0a tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:25.631866 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-7bd0df59-2785-4e8d-9284-87ed3ff9cb0a tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:25.632279 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-7bd0df59-2785-4e8d-9284-87ed3ff9cb0a tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:25.739709 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-edaa1df5-a7db-4dfc-9e1e-2fcdad740f2d tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc49f9eb3114759b2889ed8972136d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cf63c76fc543428404002ae9a75b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:21:25.750136 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-edaa1df5-a7db-4dfc-9e1e-2fcdad740f2d tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/37698c73-94da-4904-a8d5-636936092fba" status: 200 len: 1321 microversion: 2.1 time: 0.200800 Oct 31 19:21:25.755276 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 49/95] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:21:25 2022] GET /compute/v2.1/servers/37698c73-94da-4904-a8d5-636936092fba => generated 1321 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:21:25.889067 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-7bd0df59-2785-4e8d-9284-87ed3ff9cb0a tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ece6ca9374764214bac6263bd691bc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9c317b548b40deb8cb27236d36d674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:21:25.903668 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-7bd0df59-2785-4e8d-9284-87ed3ff9cb0a tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] 10.222.0.16 "GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe" status: 200 len: 1362 microversion: 2.1 time: 0.291238 Oct 31 19:21:25.912144 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 47/96] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:21:25 2022] GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe => generated 1362 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:21:26.006663 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-10cb2b16-578d-4143-a32f-df19b1d07045 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:21:26.008085 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-10cb2b16-578d-4143-a32f-df19b1d07045 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 24ad6e3e-6043-4eff-afb4-0c6039e825fa] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:21:26.022347 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-10cb2b16-578d-4143-a32f-df19b1d07045 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:26.024404 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-10cb2b16-578d-4143-a32f-df19b1d07045 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:26.026223 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-10cb2b16-578d-4143-a32f-df19b1d07045 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:26.026963 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-10cb2b16-578d-4143-a32f-df19b1d07045 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:26.029439 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-10cb2b16-578d-4143-a32f-df19b1d07045 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:26.031504 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-10cb2b16-578d-4143-a32f-df19b1d07045 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:26.263525 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-93232b19-c217-4e4d-af5a-8ee3619d02d9 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:21:26.265141 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-93232b19-c217-4e4d-af5a-8ee3619d02d9 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] [instance: 98a9a544-4553-4083-aa26-1dc327369d54] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:21:26.268142 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG dbcounter [-] [118727] Writing DB stats nova_cell0:SELECT=2 {{(pid=118727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:21:26.279606 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-93232b19-c217-4e4d-af5a-8ee3619d02d9 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:26.281474 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-93232b19-c217-4e4d-af5a-8ee3619d02d9 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:26.282389 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-93232b19-c217-4e4d-af5a-8ee3619d02d9 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:26.284820 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-93232b19-c217-4e4d-af5a-8ee3619d02d9 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:26.286653 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-93232b19-c217-4e4d-af5a-8ee3619d02d9 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:26.287263 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-93232b19-c217-4e4d-af5a-8ee3619d02d9 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:26.318813 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG dbcounter [-] [118727] Writing DB stats nova_cell1:SELECT=100 {{(pid=118727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:21:26.342554 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-10cb2b16-578d-4143-a32f-df19b1d07045 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:21:26.354090 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-10cb2b16-578d-4143-a32f-df19b1d07045 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:21:26.356083 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-10cb2b16-578d-4143-a32f-df19b1d07045 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:21:26.357833 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-10cb2b16-578d-4143-a32f-df19b1d07045 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa" status: 200 len: 1599 microversion: 2.20 time: 0.357092 Oct 31 19:21:26.358885 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 50/97] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 31 19:21:25 2022] GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa => generated 1599 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 19:21:26.396366 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-e43671af-eb14-4792-9e9c-f70f6d5d5970 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:21:26.396881 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-e43671af-eb14-4792-9e9c-f70f6d5d5970 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 24ad6e3e-6043-4eff-afb4-0c6039e825fa] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:21:26.409672 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-e43671af-eb14-4792-9e9c-f70f6d5d5970 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:26.411375 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-e43671af-eb14-4792-9e9c-f70f6d5d5970 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:26.411895 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-e43671af-eb14-4792-9e9c-f70f6d5d5970 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:26.412672 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-e43671af-eb14-4792-9e9c-f70f6d5d5970 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:26.413162 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-e43671af-eb14-4792-9e9c-f70f6d5d5970 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:26.413656 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-e43671af-eb14-4792-9e9c-f70f6d5d5970 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:26.475620 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-93232b19-c217-4e4d-af5a-8ee3619d02d9 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af27927be0e249bfb320652152f501bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c549a25d33441e98aae78e940a69c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:21:26.484050 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-93232b19-c217-4e4d-af5a-8ee3619d02d9 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] 10.222.0.16 "GET /compute/v2.1/servers/98a9a544-4553-4083-aa26-1dc327369d54" status: 200 len: 1314 microversion: 2.1 time: 0.226113 Oct 31 19:21:26.484636 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 48/98] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:21:26 2022] GET /compute/v2.1/servers/98a9a544-4553-4083-aa26-1dc327369d54 => generated 1314 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:21:26.590581 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-e43671af-eb14-4792-9e9c-f70f6d5d5970 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.203168 Oct 31 19:21:26.591310 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 51/99] 10.222.0.16 () {60 vars in 1316 bytes} [Mon Oct 31 19:21:26 2022] GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa/os-interface => generated 284 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 19:21:26.704148 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [req-81cfdbeb-2303-4b78-9141-08a8c06f3aee req-8cf5b449-b3e5-4e97-afc2-2a32c2424246 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98a9a544-4553-4083-aa26-1dc327369d54", "name": "network-vif-plugged", "status": "completed", "tag": "c411fd72-ddd2-4429-98b0-69e862f32b98"}, {"server_uuid": "7a47cd33-e4a0-4b78-9afc-2f371e4a9d10", "name": "network-vif-plugged", "status": "completed", "tag": "c1f5b141-b428-4cbf-9938-2df49ece4368"}, {"server_uuid": "0a122a08-bc0f-40fd-8139-74c9e8a70ebe", "name": "network-vif-plugged", "status": "completed", "tag": "810ffdd3-13de-43d5-a09c-221911cc3bcf"}]} {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:21:26.719329 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [req-81cfdbeb-2303-4b78-9141-08a8c06f3aee req-8cf5b449-b3e5-4e97-afc2-2a32c2424246 service nova] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:26.720326 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [req-81cfdbeb-2303-4b78-9141-08a8c06f3aee req-8cf5b449-b3e5-4e97-afc2-2a32c2424246 service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:26.720908 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [req-81cfdbeb-2303-4b78-9141-08a8c06f3aee req-8cf5b449-b3e5-4e97-afc2-2a32c2424246 service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:26.742668 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.compute.server_external_events [req-81cfdbeb-2303-4b78-9141-08a8c06f3aee req-8cf5b449-b3e5-4e97-afc2-2a32c2424246 service nova] Creating event network-vif-plugged:c411fd72-ddd2-4429-98b0-69e862f32b98 for instance 98a9a544-4553-4083-aa26-1dc327369d54 on hv-cinder-86309 Oct 31 19:21:26.747678 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.compute.server_external_events [req-81cfdbeb-2303-4b78-9141-08a8c06f3aee req-8cf5b449-b3e5-4e97-afc2-2a32c2424246 service nova] Creating event network-vif-plugged:c1f5b141-b428-4cbf-9938-2df49ece4368 for instance 7a47cd33-e4a0-4b78-9afc-2f371e4a9d10 on hv-cinder-86309 Oct 31 19:21:26.748233 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.compute.server_external_events [req-81cfdbeb-2303-4b78-9141-08a8c06f3aee req-8cf5b449-b3e5-4e97-afc2-2a32c2424246 service nova] Creating event network-vif-plugged:810ffdd3-13de-43d5-a09c-221911cc3bcf for instance 0a122a08-bc0f-40fd-8139-74c9e8a70ebe on hv-cinder-86309 Oct 31 19:21:26.778215 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [req-81cfdbeb-2303-4b78-9141-08a8c06f3aee req-8cf5b449-b3e5-4e97-afc2-2a32c2424246 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.069244 Oct 31 19:21:26.780006 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 49/100] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 31 19:21:26 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:21:26.780115 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-d8fea86d-40d7-43ea-8028-81f2b067c468 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:21:26.780720 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-d8fea86d-40d7-43ea-8028-81f2b067c468 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 37698c73-94da-4904-a8d5-636936092fba] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:21:26.790321 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-d8fea86d-40d7-43ea-8028-81f2b067c468 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:26.800868 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-d8fea86d-40d7-43ea-8028-81f2b067c468 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:26.803335 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-d8fea86d-40d7-43ea-8028-81f2b067c468 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:26.805071 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-d8fea86d-40d7-43ea-8028-81f2b067c468 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:26.806709 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-d8fea86d-40d7-43ea-8028-81f2b067c468 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:26.807323 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-d8fea86d-40d7-43ea-8028-81f2b067c468 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:26.941385 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-1494ad1c-e984-4106-b19e-cc8146e240af tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:21:26.942880 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-1494ad1c-e984-4106-b19e-cc8146e240af tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] [instance: 0a122a08-bc0f-40fd-8139-74c9e8a70ebe] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:21:26.972380 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-1494ad1c-e984-4106-b19e-cc8146e240af tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:26.973811 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-1494ad1c-e984-4106-b19e-cc8146e240af tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:26.974390 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-1494ad1c-e984-4106-b19e-cc8146e240af tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:26.977823 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-1494ad1c-e984-4106-b19e-cc8146e240af tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:26.978517 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-1494ad1c-e984-4106-b19e-cc8146e240af tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:26.980223 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-1494ad1c-e984-4106-b19e-cc8146e240af tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:27.231808 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-d8fea86d-40d7-43ea-8028-81f2b067c468 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc49f9eb3114759b2889ed8972136d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cf63c76fc543428404002ae9a75b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:21:27.242407 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-d8fea86d-40d7-43ea-8028-81f2b067c468 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/37698c73-94da-4904-a8d5-636936092fba" status: 200 len: 1321 microversion: 2.1 time: 0.472458 Oct 31 19:21:27.244527 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 52/101] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:21:26 2022] GET /compute/v2.1/servers/37698c73-94da-4904-a8d5-636936092fba => generated 1321 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 19:21:27.511356 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-b41327f0-3845-4ae3-9133-0dac94132bc2 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:21:27.512206 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-b41327f0-3845-4ae3-9133-0dac94132bc2 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] [instance: 98a9a544-4553-4083-aa26-1dc327369d54] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:21:27.524125 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-1494ad1c-e984-4106-b19e-cc8146e240af tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ece6ca9374764214bac6263bd691bc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9c317b548b40deb8cb27236d36d674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:21:27.524558 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-b41327f0-3845-4ae3-9133-0dac94132bc2 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:27.524655 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-b41327f0-3845-4ae3-9133-0dac94132bc2 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:27.525083 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-b41327f0-3845-4ae3-9133-0dac94132bc2 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:27.525816 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-b41327f0-3845-4ae3-9133-0dac94132bc2 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:27.536152 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-b41327f0-3845-4ae3-9133-0dac94132bc2 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:27.536956 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-b41327f0-3845-4ae3-9133-0dac94132bc2 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:27.537751 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-1494ad1c-e984-4106-b19e-cc8146e240af tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] 10.222.0.16 "GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe" status: 200 len: 1362 microversion: 2.1 time: 0.607456 Oct 31 19:21:27.538431 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 50/102] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:21:26 2022] GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe => generated 1362 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:21:27.961277 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-b41327f0-3845-4ae3-9133-0dac94132bc2 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af27927be0e249bfb320652152f501bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c549a25d33441e98aae78e940a69c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:21:27.978726 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-b41327f0-3845-4ae3-9133-0dac94132bc2 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] 10.222.0.16 "GET /compute/v2.1/servers/98a9a544-4553-4083-aa26-1dc327369d54" status: 200 len: 1314 microversion: 2.1 time: 0.471622 Oct 31 19:21:27.979330 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 53/103] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:21:27 2022] GET /compute/v2.1/servers/98a9a544-4553-4083-aa26-1dc327369d54 => generated 1314 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:21:28.267600 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-62d927ad-d4fd-4e58-9c07-bbec7d903a86 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:21:28.268452 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-62d927ad-d4fd-4e58-9c07-bbec7d903a86 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 37698c73-94da-4904-a8d5-636936092fba] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:21:28.275343 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-62d927ad-d4fd-4e58-9c07-bbec7d903a86 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:28.275929 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-62d927ad-d4fd-4e58-9c07-bbec7d903a86 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:28.276444 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-62d927ad-d4fd-4e58-9c07-bbec7d903a86 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:28.277222 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-62d927ad-d4fd-4e58-9c07-bbec7d903a86 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:28.277751 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-62d927ad-d4fd-4e58-9c07-bbec7d903a86 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:28.278410 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-62d927ad-d4fd-4e58-9c07-bbec7d903a86 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:28.559892 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-36c4beea-85be-40cf-8e1f-5b2797010fe0 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:21:28.561081 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-36c4beea-85be-40cf-8e1f-5b2797010fe0 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] [instance: 0a122a08-bc0f-40fd-8139-74c9e8a70ebe] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:21:28.567562 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-36c4beea-85be-40cf-8e1f-5b2797010fe0 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:28.568298 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-36c4beea-85be-40cf-8e1f-5b2797010fe0 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:28.568923 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-36c4beea-85be-40cf-8e1f-5b2797010fe0 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:28.569836 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-36c4beea-85be-40cf-8e1f-5b2797010fe0 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:28.570487 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-36c4beea-85be-40cf-8e1f-5b2797010fe0 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:28.571122 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-36c4beea-85be-40cf-8e1f-5b2797010fe0 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:28.614796 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-62d927ad-d4fd-4e58-9c07-bbec7d903a86 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc49f9eb3114759b2889ed8972136d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cf63c76fc543428404002ae9a75b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:21:28.647936 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-62d927ad-d4fd-4e58-9c07-bbec7d903a86 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/37698c73-94da-4904-a8d5-636936092fba" status: 200 len: 1514 microversion: 2.1 time: 0.384676 Oct 31 19:21:28.648784 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 51/104] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:21:28 2022] GET /compute/v2.1/servers/37698c73-94da-4904-a8d5-636936092fba => generated 1514 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:21:28.658661 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [req-0fbbbf2e-d369-4269-a3f7-90f027775dc4 req-74c8a09b-737a-460f-8ed1-06719b7e4a80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24ad6e3e-6043-4eff-afb4-0c6039e825fa", "tag": "3807af14-6f9a-4bcc-86d0-c9961d4697ae"}]} {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:21:28.671970 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [req-0fbbbf2e-d369-4269-a3f7-90f027775dc4 req-74c8a09b-737a-460f-8ed1-06719b7e4a80 service nova] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:28.672558 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [req-0fbbbf2e-d369-4269-a3f7-90f027775dc4 req-74c8a09b-737a-460f-8ed1-06719b7e4a80 service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:28.673080 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [req-0fbbbf2e-d369-4269-a3f7-90f027775dc4 req-74c8a09b-737a-460f-8ed1-06719b7e4a80 service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:28.685316 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.compute.server_external_events [req-0fbbbf2e-d369-4269-a3f7-90f027775dc4 req-74c8a09b-737a-460f-8ed1-06719b7e4a80 service nova] Creating event network-changed:3807af14-6f9a-4bcc-86d0-c9961d4697ae for instance 24ad6e3e-6043-4eff-afb4-0c6039e825fa on hv-cinder-86309 Oct 31 19:21:28.690924 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [req-0fbbbf2e-d369-4269-a3f7-90f027775dc4 req-74c8a09b-737a-460f-8ed1-06719b7e4a80 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040694 Oct 31 19:21:28.704570 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 52/105] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 31 19:21:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:21:28.714474 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-43360369-b31e-4d6c-a4ae-0c840eab5b1e tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:21:28.717175 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-43360369-b31e-4d6c-a4ae-0c840eab5b1e tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 37698c73-94da-4904-a8d5-636936092fba] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:21:28.725227 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-43360369-b31e-4d6c-a4ae-0c840eab5b1e tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:28.725890 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-43360369-b31e-4d6c-a4ae-0c840eab5b1e tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:28.726332 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-43360369-b31e-4d6c-a4ae-0c840eab5b1e tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:28.727034 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-43360369-b31e-4d6c-a4ae-0c840eab5b1e tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:28.727546 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-43360369-b31e-4d6c-a4ae-0c840eab5b1e tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:28.728005 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-43360369-b31e-4d6c-a4ae-0c840eab5b1e tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:28.795156 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.objects.instance [None req-43360369-b31e-4d6c-a4ae-0c840eab5b1e tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lazy-loading 'flavor' on Instance uuid 37698c73-94da-4904-a8d5-636936092fba {{(pid=118727) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 19:21:28.811163 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-36c4beea-85be-40cf-8e1f-5b2797010fe0 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ece6ca9374764214bac6263bd691bc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9c317b548b40deb8cb27236d36d674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:21:28.820229 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-36c4beea-85be-40cf-8e1f-5b2797010fe0 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] 10.222.0.16 "GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe" status: 200 len: 1362 microversion: 2.1 time: 0.263951 Oct 31 19:21:28.821267 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 54/106] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:21:28 2022] GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe => generated 1362 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 19:21:28.971251 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-43360369-b31e-4d6c-a4ae-0c840eab5b1e tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "POST /compute/v2.1/servers/37698c73-94da-4904-a8d5-636936092fba/action" status: 200 len: 32 microversion: 2.1 time: 0.264330 Oct 31 19:21:28.971872 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 53/107] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 31 19:21:28 2022] POST /compute/v2.1/servers/37698c73-94da-4904-a8d5-636936092fba/action => generated 32 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 19:21:28.982591 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-eb7aa2dc-5057-412f-9e57-86177657a243 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:21:28.983207 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-eb7aa2dc-5057-412f-9e57-86177657a243 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 37698c73-94da-4904-a8d5-636936092fba] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:21:28.990013 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-eb7aa2dc-5057-412f-9e57-86177657a243 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:28.990587 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-eb7aa2dc-5057-412f-9e57-86177657a243 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:28.991025 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-eb7aa2dc-5057-412f-9e57-86177657a243 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:28.991712 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-eb7aa2dc-5057-412f-9e57-86177657a243 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:28.992736 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-eb7aa2dc-5057-412f-9e57-86177657a243 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:28.993091 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-eb7aa2dc-5057-412f-9e57-86177657a243 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:29.004913 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-8ef23781-39fe-4354-a911-5d8df7c1da24 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:21:29.005945 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-8ef23781-39fe-4354-a911-5d8df7c1da24 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] [instance: 98a9a544-4553-4083-aa26-1dc327369d54] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:21:29.013157 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-8ef23781-39fe-4354-a911-5d8df7c1da24 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:29.013944 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-8ef23781-39fe-4354-a911-5d8df7c1da24 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:29.014779 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-8ef23781-39fe-4354-a911-5d8df7c1da24 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:29.015689 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-8ef23781-39fe-4354-a911-5d8df7c1da24 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:29.016369 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-8ef23781-39fe-4354-a911-5d8df7c1da24 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:29.016969 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-8ef23781-39fe-4354-a911-5d8df7c1da24 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:29.134373 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-eb7aa2dc-5057-412f-9e57-86177657a243 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc49f9eb3114759b2889ed8972136d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cf63c76fc543428404002ae9a75b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:21:29.142408 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-eb7aa2dc-5057-412f-9e57-86177657a243 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/37698c73-94da-4904-a8d5-636936092fba" status: 200 len: 1520 microversion: 2.1 time: 0.164125 Oct 31 19:21:29.143316 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 55/108] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:21:28 2022] GET /compute/v2.1/servers/37698c73-94da-4904-a8d5-636936092fba => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:21:29.166988 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-8ef23781-39fe-4354-a911-5d8df7c1da24 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af27927be0e249bfb320652152f501bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c549a25d33441e98aae78e940a69c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:21:29.174538 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-8ef23781-39fe-4354-a911-5d8df7c1da24 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] 10.222.0.16 "GET /compute/v2.1/servers/98a9a544-4553-4083-aa26-1dc327369d54" status: 200 len: 1314 microversion: 2.1 time: 0.174302 Oct 31 19:21:29.175099 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 54/109] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:21:28 2022] GET /compute/v2.1/servers/98a9a544-4553-4083-aa26-1dc327369d54 => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 19:21:29.845182 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-6caf2119-33ba-4221-9db2-cb794bff5381 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:21:29.846717 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-6caf2119-33ba-4221-9db2-cb794bff5381 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] [instance: 0a122a08-bc0f-40fd-8139-74c9e8a70ebe] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:21:29.852767 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-6caf2119-33ba-4221-9db2-cb794bff5381 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:29.853429 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-6caf2119-33ba-4221-9db2-cb794bff5381 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:29.855521 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-6caf2119-33ba-4221-9db2-cb794bff5381 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:29.856649 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-6caf2119-33ba-4221-9db2-cb794bff5381 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:29.857360 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-6caf2119-33ba-4221-9db2-cb794bff5381 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:29.858546 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-6caf2119-33ba-4221-9db2-cb794bff5381 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:30.006780 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-6caf2119-33ba-4221-9db2-cb794bff5381 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ece6ca9374764214bac6263bd691bc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9c317b548b40deb8cb27236d36d674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:21:30.014661 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-6caf2119-33ba-4221-9db2-cb794bff5381 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] 10.222.0.16 "GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe" status: 200 len: 1362 microversion: 2.1 time: 0.174651 Oct 31 19:21:30.015286 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 56/110] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:21:29 2022] GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe => generated 1362 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:21:30.168287 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-8d028bd6-7430-4949-b201-32a87969689b tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:21:30.168896 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-8d028bd6-7430-4949-b201-32a87969689b tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 37698c73-94da-4904-a8d5-636936092fba] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:21:30.179367 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-8d028bd6-7430-4949-b201-32a87969689b tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:30.180361 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-8d028bd6-7430-4949-b201-32a87969689b tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:30.181687 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-8d028bd6-7430-4949-b201-32a87969689b tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:30.183577 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-8d028bd6-7430-4949-b201-32a87969689b tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:30.184034 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-8d028bd6-7430-4949-b201-32a87969689b tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:30.184736 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-8d028bd6-7430-4949-b201-32a87969689b tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:30.199435 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-a7224f70-30f6-45a6-828e-85e062e6ca36 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:21:30.200171 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-a7224f70-30f6-45a6-828e-85e062e6ca36 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] [instance: 98a9a544-4553-4083-aa26-1dc327369d54] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:21:30.214578 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-a7224f70-30f6-45a6-828e-85e062e6ca36 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:30.215457 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-a7224f70-30f6-45a6-828e-85e062e6ca36 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:30.216421 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-a7224f70-30f6-45a6-828e-85e062e6ca36 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:30.217224 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-a7224f70-30f6-45a6-828e-85e062e6ca36 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:30.218222 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-a7224f70-30f6-45a6-828e-85e062e6ca36 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:30.220221 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-a7224f70-30f6-45a6-828e-85e062e6ca36 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:30.426809 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-a7224f70-30f6-45a6-828e-85e062e6ca36 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af27927be0e249bfb320652152f501bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c549a25d33441e98aae78e940a69c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:21:30.435231 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-a7224f70-30f6-45a6-828e-85e062e6ca36 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] 10.222.0.16 "GET /compute/v2.1/servers/98a9a544-4553-4083-aa26-1dc327369d54" status: 200 len: 1314 microversion: 2.1 time: 0.241356 Oct 31 19:21:30.448526 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-8d028bd6-7430-4949-b201-32a87969689b tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc49f9eb3114759b2889ed8972136d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cf63c76fc543428404002ae9a75b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:21:30.450097 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 57/111] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:21:30 2022] GET /compute/v2.1/servers/98a9a544-4553-4083-aa26-1dc327369d54 => generated 1314 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 19:21:30.457782 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-8d028bd6-7430-4949-b201-32a87969689b tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/37698c73-94da-4904-a8d5-636936092fba" status: 200 len: 1520 microversion: 2.1 time: 0.294110 Oct 31 19:21:30.458695 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 55/112] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:21:30 2022] GET /compute/v2.1/servers/37698c73-94da-4904-a8d5-636936092fba => generated 1520 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 19:21:31.039523 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-583a15c7-d8c3-47c2-a70f-1ae35c6574d8 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:21:31.040175 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-583a15c7-d8c3-47c2-a70f-1ae35c6574d8 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] [instance: 0a122a08-bc0f-40fd-8139-74c9e8a70ebe] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:21:31.047142 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-583a15c7-d8c3-47c2-a70f-1ae35c6574d8 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:31.047661 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-583a15c7-d8c3-47c2-a70f-1ae35c6574d8 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:31.048105 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-583a15c7-d8c3-47c2-a70f-1ae35c6574d8 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:31.049041 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-583a15c7-d8c3-47c2-a70f-1ae35c6574d8 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:31.049852 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-583a15c7-d8c3-47c2-a70f-1ae35c6574d8 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:31.050543 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-583a15c7-d8c3-47c2-a70f-1ae35c6574d8 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:31.206241 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-583a15c7-d8c3-47c2-a70f-1ae35c6574d8 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ece6ca9374764214bac6263bd691bc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9c317b548b40deb8cb27236d36d674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:21:31.214268 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-583a15c7-d8c3-47c2-a70f-1ae35c6574d8 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] 10.222.0.16 "GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe" status: 200 len: 1362 microversion: 2.1 time: 0.179870 Oct 31 19:21:31.215267 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 58/113] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:21:31 2022] GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe => generated 1362 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:21:31.458853 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-5b637ef0-c6d4-420e-a299-c4b296cf3e0f tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:21:31.459652 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-5b637ef0-c6d4-420e-a299-c4b296cf3e0f tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] [instance: 98a9a544-4553-4083-aa26-1dc327369d54] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:21:31.467292 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-5b637ef0-c6d4-420e-a299-c4b296cf3e0f tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:31.467781 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-5b637ef0-c6d4-420e-a299-c4b296cf3e0f tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:31.468214 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-5b637ef0-c6d4-420e-a299-c4b296cf3e0f tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:31.468908 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-5b637ef0-c6d4-420e-a299-c4b296cf3e0f tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:31.469363 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-5b637ef0-c6d4-420e-a299-c4b296cf3e0f tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:31.469817 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-5b637ef0-c6d4-420e-a299-c4b296cf3e0f tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:31.482200 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-95a4d711-5291-48fb-819a-ce3f4dbf65c5 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:21:31.482815 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-95a4d711-5291-48fb-819a-ce3f4dbf65c5 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 37698c73-94da-4904-a8d5-636936092fba] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:21:31.488918 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-95a4d711-5291-48fb-819a-ce3f4dbf65c5 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:31.489636 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-95a4d711-5291-48fb-819a-ce3f4dbf65c5 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:31.490103 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-95a4d711-5291-48fb-819a-ce3f4dbf65c5 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:31.490799 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-95a4d711-5291-48fb-819a-ce3f4dbf65c5 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:31.491256 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-95a4d711-5291-48fb-819a-ce3f4dbf65c5 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:31.491676 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-95a4d711-5291-48fb-819a-ce3f4dbf65c5 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:31.639248 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-5b637ef0-c6d4-420e-a299-c4b296cf3e0f tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af27927be0e249bfb320652152f501bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c549a25d33441e98aae78e940a69c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:21:31.647435 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-5b637ef0-c6d4-420e-a299-c4b296cf3e0f tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] 10.222.0.16 "GET /compute/v2.1/servers/98a9a544-4553-4083-aa26-1dc327369d54" status: 200 len: 1314 microversion: 2.1 time: 0.193367 Oct 31 19:21:31.648012 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 56/114] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:21:31 2022] GET /compute/v2.1/servers/98a9a544-4553-4083-aa26-1dc327369d54 => generated 1314 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:21:31.695323 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-95a4d711-5291-48fb-819a-ce3f4dbf65c5 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc49f9eb3114759b2889ed8972136d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cf63c76fc543428404002ae9a75b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:21:31.703116 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-95a4d711-5291-48fb-819a-ce3f4dbf65c5 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/37698c73-94da-4904-a8d5-636936092fba" status: 200 len: 1520 microversion: 2.1 time: 0.225136 Oct 31 19:21:31.703677 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 59/115] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:21:31 2022] GET /compute/v2.1/servers/37698c73-94da-4904-a8d5-636936092fba => generated 1520 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 19:21:32.238315 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-46fec851-b89e-40cf-a52c-d4d764d3ca1a tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:21:32.238923 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-46fec851-b89e-40cf-a52c-d4d764d3ca1a tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] [instance: 0a122a08-bc0f-40fd-8139-74c9e8a70ebe] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:21:32.244758 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-46fec851-b89e-40cf-a52c-d4d764d3ca1a tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:32.245231 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-46fec851-b89e-40cf-a52c-d4d764d3ca1a tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:32.245682 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-46fec851-b89e-40cf-a52c-d4d764d3ca1a tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:32.246366 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-46fec851-b89e-40cf-a52c-d4d764d3ca1a tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:32.246814 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-46fec851-b89e-40cf-a52c-d4d764d3ca1a tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:32.247231 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-46fec851-b89e-40cf-a52c-d4d764d3ca1a tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:32.398698 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-46fec851-b89e-40cf-a52c-d4d764d3ca1a tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ece6ca9374764214bac6263bd691bc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9c317b548b40deb8cb27236d36d674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:21:32.407400 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-46fec851-b89e-40cf-a52c-d4d764d3ca1a tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] 10.222.0.16 "GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe" status: 200 len: 1362 microversion: 2.1 time: 0.172848 Oct 31 19:21:32.408174 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 57/116] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:21:32 2022] GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe => generated 1362 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:21:32.670886 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-71ca035d-9b91-4adc-84f6-48170937cfcc tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:21:32.671585 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-71ca035d-9b91-4adc-84f6-48170937cfcc tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] [instance: 98a9a544-4553-4083-aa26-1dc327369d54] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:21:32.681237 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-71ca035d-9b91-4adc-84f6-48170937cfcc tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:32.681237 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-71ca035d-9b91-4adc-84f6-48170937cfcc tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:32.681237 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-71ca035d-9b91-4adc-84f6-48170937cfcc tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:32.681237 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-71ca035d-9b91-4adc-84f6-48170937cfcc tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:32.681565 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-71ca035d-9b91-4adc-84f6-48170937cfcc tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:32.681565 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-71ca035d-9b91-4adc-84f6-48170937cfcc tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:32.728134 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-8e7d86b3-e19d-4ff6-bf80-ec549eed2a6c tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:21:32.728745 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-8e7d86b3-e19d-4ff6-bf80-ec549eed2a6c tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 37698c73-94da-4904-a8d5-636936092fba] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:21:32.736108 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-8e7d86b3-e19d-4ff6-bf80-ec549eed2a6c tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:32.736616 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-8e7d86b3-e19d-4ff6-bf80-ec549eed2a6c tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:32.737255 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-8e7d86b3-e19d-4ff6-bf80-ec549eed2a6c tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:32.738122 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-8e7d86b3-e19d-4ff6-bf80-ec549eed2a6c tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:32.739180 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-8e7d86b3-e19d-4ff6-bf80-ec549eed2a6c tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:32.739605 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-8e7d86b3-e19d-4ff6-bf80-ec549eed2a6c tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:32.820400 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-71ca035d-9b91-4adc-84f6-48170937cfcc tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af27927be0e249bfb320652152f501bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c549a25d33441e98aae78e940a69c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:21:32.828136 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-71ca035d-9b91-4adc-84f6-48170937cfcc tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] 10.222.0.16 "GET /compute/v2.1/servers/98a9a544-4553-4083-aa26-1dc327369d54" status: 200 len: 1314 microversion: 2.1 time: 0.161298 Oct 31 19:21:32.842220 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 60/117] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:21:32 2022] GET /compute/v2.1/servers/98a9a544-4553-4083-aa26-1dc327369d54 => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:21:32.888926 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-8e7d86b3-e19d-4ff6-bf80-ec549eed2a6c tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc49f9eb3114759b2889ed8972136d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cf63c76fc543428404002ae9a75b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:21:32.897930 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-8e7d86b3-e19d-4ff6-bf80-ec549eed2a6c tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/37698c73-94da-4904-a8d5-636936092fba" status: 200 len: 1520 microversion: 2.1 time: 0.175385 Oct 31 19:21:32.898495 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 58/118] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:21:32 2022] GET /compute/v2.1/servers/37698c73-94da-4904-a8d5-636936092fba => generated 1520 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 19:21:33.448443 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-eeec80ba-ee28-4e73-82fe-aea3d1bdcddc tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:21:33.449065 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-eeec80ba-ee28-4e73-82fe-aea3d1bdcddc tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] [instance: 0a122a08-bc0f-40fd-8139-74c9e8a70ebe] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:21:33.454944 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-eeec80ba-ee28-4e73-82fe-aea3d1bdcddc tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:33.455426 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-eeec80ba-ee28-4e73-82fe-aea3d1bdcddc tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:33.455853 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-eeec80ba-ee28-4e73-82fe-aea3d1bdcddc tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:33.456531 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-eeec80ba-ee28-4e73-82fe-aea3d1bdcddc tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:33.456979 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-eeec80ba-ee28-4e73-82fe-aea3d1bdcddc tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:33.457971 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-eeec80ba-ee28-4e73-82fe-aea3d1bdcddc tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:33.604617 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-eeec80ba-ee28-4e73-82fe-aea3d1bdcddc tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ece6ca9374764214bac6263bd691bc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9c317b548b40deb8cb27236d36d674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:21:33.615103 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-eeec80ba-ee28-4e73-82fe-aea3d1bdcddc tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] 10.222.0.16 "GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe" status: 200 len: 1362 microversion: 2.1 time: 0.170458 Oct 31 19:21:33.615701 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 61/119] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:21:33 2022] GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe => generated 1362 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:21:33.852029 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-9547a652-5dca-479d-b952-65ba56b9efc6 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:21:33.852792 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-9547a652-5dca-479d-b952-65ba56b9efc6 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] [instance: 98a9a544-4553-4083-aa26-1dc327369d54] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:21:33.854764 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG dbcounter [-] [118727] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3 {{(pid=118727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:21:33.860143 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-9547a652-5dca-479d-b952-65ba56b9efc6 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:33.860629 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-9547a652-5dca-479d-b952-65ba56b9efc6 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:33.861062 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-9547a652-5dca-479d-b952-65ba56b9efc6 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:33.861805 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-9547a652-5dca-479d-b952-65ba56b9efc6 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:33.862260 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-9547a652-5dca-479d-b952-65ba56b9efc6 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:33.862682 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-9547a652-5dca-479d-b952-65ba56b9efc6 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:33.922288 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-201ea160-e2ab-41e4-8f99-f1aafa9a0802 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:21:33.923039 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-201ea160-e2ab-41e4-8f99-f1aafa9a0802 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 37698c73-94da-4904-a8d5-636936092fba] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:21:33.929186 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-201ea160-e2ab-41e4-8f99-f1aafa9a0802 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:33.929833 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-201ea160-e2ab-41e4-8f99-f1aafa9a0802 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:33.930496 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-201ea160-e2ab-41e4-8f99-f1aafa9a0802 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:33.931282 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-201ea160-e2ab-41e4-8f99-f1aafa9a0802 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:33.931874 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-201ea160-e2ab-41e4-8f99-f1aafa9a0802 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:33.932394 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-201ea160-e2ab-41e4-8f99-f1aafa9a0802 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:33.955848 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG dbcounter [-] [118726] Writing DB stats nova_cell1:SELECT=100 {{(pid=118726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:21:34.026498 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-9547a652-5dca-479d-b952-65ba56b9efc6 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af27927be0e249bfb320652152f501bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c549a25d33441e98aae78e940a69c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:21:34.039133 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-9547a652-5dca-479d-b952-65ba56b9efc6 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] 10.222.0.16 "GET /compute/v2.1/servers/98a9a544-4553-4083-aa26-1dc327369d54" status: 200 len: 1314 microversion: 2.1 time: 0.191773 Oct 31 19:21:34.039904 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 59/120] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:21:33 2022] GET /compute/v2.1/servers/98a9a544-4553-4083-aa26-1dc327369d54 => generated 1314 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:21:34.070773 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-201ea160-e2ab-41e4-8f99-f1aafa9a0802 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc49f9eb3114759b2889ed8972136d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cf63c76fc543428404002ae9a75b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:21:34.078421 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-201ea160-e2ab-41e4-8f99-f1aafa9a0802 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/37698c73-94da-4904-a8d5-636936092fba" status: 200 len: 1520 microversion: 2.1 time: 0.160042 Oct 31 19:21:34.078977 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 62/121] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:21:33 2022] GET /compute/v2.1/servers/37698c73-94da-4904-a8d5-636936092fba => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:21:34.637575 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-e6be6c96-f2e5-4369-97d8-44c7640547e0 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:21:34.638218 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-e6be6c96-f2e5-4369-97d8-44c7640547e0 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] [instance: 0a122a08-bc0f-40fd-8139-74c9e8a70ebe] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:21:34.644371 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-e6be6c96-f2e5-4369-97d8-44c7640547e0 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:34.644861 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-e6be6c96-f2e5-4369-97d8-44c7640547e0 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:34.645285 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-e6be6c96-f2e5-4369-97d8-44c7640547e0 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:34.646006 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-e6be6c96-f2e5-4369-97d8-44c7640547e0 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:34.646461 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-e6be6c96-f2e5-4369-97d8-44c7640547e0 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:34.646879 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-e6be6c96-f2e5-4369-97d8-44c7640547e0 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:34.808409 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-e6be6c96-f2e5-4369-97d8-44c7640547e0 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ece6ca9374764214bac6263bd691bc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9c317b548b40deb8cb27236d36d674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:21:34.817456 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-e6be6c96-f2e5-4369-97d8-44c7640547e0 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] 10.222.0.16 "GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe" status: 200 len: 1362 microversion: 2.1 time: 0.183170 Oct 31 19:21:34.818072 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 60/122] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:21:34 2022] GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe => generated 1362 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:21:35.066175 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-0b83dd25-10a8-43e6-9989-32851bf3cbbe tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:21:35.067915 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-0b83dd25-10a8-43e6-9989-32851bf3cbbe tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] [instance: 98a9a544-4553-4083-aa26-1dc327369d54] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:21:35.074594 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-0b83dd25-10a8-43e6-9989-32851bf3cbbe tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:35.075196 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-0b83dd25-10a8-43e6-9989-32851bf3cbbe tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:35.075630 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-0b83dd25-10a8-43e6-9989-32851bf3cbbe tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:35.076316 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-0b83dd25-10a8-43e6-9989-32851bf3cbbe tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:35.076770 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-0b83dd25-10a8-43e6-9989-32851bf3cbbe tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:35.077259 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-0b83dd25-10a8-43e6-9989-32851bf3cbbe tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:35.103368 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-130a37f5-7eb3-4735-90fd-a87b60f63b9d tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:21:35.103969 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-130a37f5-7eb3-4735-90fd-a87b60f63b9d tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 37698c73-94da-4904-a8d5-636936092fba] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:21:35.111037 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-130a37f5-7eb3-4735-90fd-a87b60f63b9d tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:35.111896 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-130a37f5-7eb3-4735-90fd-a87b60f63b9d tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:35.112547 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-130a37f5-7eb3-4735-90fd-a87b60f63b9d tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:35.113868 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-130a37f5-7eb3-4735-90fd-a87b60f63b9d tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:35.115087 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-130a37f5-7eb3-4735-90fd-a87b60f63b9d tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:35.115726 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-130a37f5-7eb3-4735-90fd-a87b60f63b9d tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:35.289182 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-0b83dd25-10a8-43e6-9989-32851bf3cbbe tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af27927be0e249bfb320652152f501bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c549a25d33441e98aae78e940a69c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:21:35.297814 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-0b83dd25-10a8-43e6-9989-32851bf3cbbe tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] 10.222.0.16 "GET /compute/v2.1/servers/98a9a544-4553-4083-aa26-1dc327369d54" status: 200 len: 1314 microversion: 2.1 time: 0.239089 Oct 31 19:21:35.298397 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 63/123] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:21:35 2022] GET /compute/v2.1/servers/98a9a544-4553-4083-aa26-1dc327369d54 => generated 1314 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:21:35.410613 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-130a37f5-7eb3-4735-90fd-a87b60f63b9d tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc49f9eb3114759b2889ed8972136d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cf63c76fc543428404002ae9a75b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:21:35.419246 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-130a37f5-7eb3-4735-90fd-a87b60f63b9d tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/37698c73-94da-4904-a8d5-636936092fba" status: 200 len: 1520 microversion: 2.1 time: 0.319888 Oct 31 19:21:35.419821 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 61/124] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:21:35 2022] GET /compute/v2.1/servers/37698c73-94da-4904-a8d5-636936092fba => generated 1520 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 19:21:35.840049 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-86a14552-d3d7-4770-91a1-dbb4dd8fa260 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:21:35.840693 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-86a14552-d3d7-4770-91a1-dbb4dd8fa260 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] [instance: 0a122a08-bc0f-40fd-8139-74c9e8a70ebe] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:21:35.846537 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-86a14552-d3d7-4770-91a1-dbb4dd8fa260 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:35.847016 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-86a14552-d3d7-4770-91a1-dbb4dd8fa260 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:35.847445 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-86a14552-d3d7-4770-91a1-dbb4dd8fa260 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:35.848622 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-86a14552-d3d7-4770-91a1-dbb4dd8fa260 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:35.849070 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-86a14552-d3d7-4770-91a1-dbb4dd8fa260 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:35.849488 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-86a14552-d3d7-4770-91a1-dbb4dd8fa260 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:35.978815 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-86a14552-d3d7-4770-91a1-dbb4dd8fa260 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ece6ca9374764214bac6263bd691bc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9c317b548b40deb8cb27236d36d674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:21:35.986496 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-86a14552-d3d7-4770-91a1-dbb4dd8fa260 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] 10.222.0.16 "GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe" status: 200 len: 1362 microversion: 2.1 time: 0.150254 Oct 31 19:21:35.987206 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 64/125] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:21:35 2022] GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 19:21:36.320796 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-23824f92-9eae-4330-88f0-c9e45ccf1e5a tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:21:36.321587 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-23824f92-9eae-4330-88f0-c9e45ccf1e5a tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] [instance: 98a9a544-4553-4083-aa26-1dc327369d54] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:21:36.327689 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-23824f92-9eae-4330-88f0-c9e45ccf1e5a tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:36.328169 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-23824f92-9eae-4330-88f0-c9e45ccf1e5a tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:36.328607 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-23824f92-9eae-4330-88f0-c9e45ccf1e5a tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:36.329292 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-23824f92-9eae-4330-88f0-c9e45ccf1e5a tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:36.329778 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-23824f92-9eae-4330-88f0-c9e45ccf1e5a tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:36.330200 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-23824f92-9eae-4330-88f0-c9e45ccf1e5a tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:36.443697 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-49d4d7f2-cf0f-4fd2-8765-8c562aee7a5e tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:21:36.444327 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-49d4d7f2-cf0f-4fd2-8765-8c562aee7a5e tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 37698c73-94da-4904-a8d5-636936092fba] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:21:36.451832 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-49d4d7f2-cf0f-4fd2-8765-8c562aee7a5e tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:36.452800 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-49d4d7f2-cf0f-4fd2-8765-8c562aee7a5e tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:36.453284 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-49d4d7f2-cf0f-4fd2-8765-8c562aee7a5e tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:36.454190 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-49d4d7f2-cf0f-4fd2-8765-8c562aee7a5e tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:36.454982 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-49d4d7f2-cf0f-4fd2-8765-8c562aee7a5e tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:36.455562 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-49d4d7f2-cf0f-4fd2-8765-8c562aee7a5e tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:36.466147 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-23824f92-9eae-4330-88f0-c9e45ccf1e5a tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af27927be0e249bfb320652152f501bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c549a25d33441e98aae78e940a69c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:21:36.475834 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-23824f92-9eae-4330-88f0-c9e45ccf1e5a tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] 10.222.0.16 "GET /compute/v2.1/servers/98a9a544-4553-4083-aa26-1dc327369d54" status: 200 len: 1314 microversion: 2.1 time: 0.159344 Oct 31 19:21:36.476646 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 62/126] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:21:36 2022] GET /compute/v2.1/servers/98a9a544-4553-4083-aa26-1dc327369d54 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:21:36.692253 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-49d4d7f2-cf0f-4fd2-8765-8c562aee7a5e tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc49f9eb3114759b2889ed8972136d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cf63c76fc543428404002ae9a75b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:21:36.718406 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-49d4d7f2-cf0f-4fd2-8765-8c562aee7a5e tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/37698c73-94da-4904-a8d5-636936092fba" status: 200 len: 1520 microversion: 2.1 time: 0.279565 Oct 31 19:21:36.719627 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 65/127] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:21:36 2022] GET /compute/v2.1/servers/37698c73-94da-4904-a8d5-636936092fba => generated 1520 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:21:37.009521 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-f59e4f3c-4eba-4965-b1d4-579440e7aaf6 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:21:37.010086 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-f59e4f3c-4eba-4965-b1d4-579440e7aaf6 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] [instance: 0a122a08-bc0f-40fd-8139-74c9e8a70ebe] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:21:37.015935 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-f59e4f3c-4eba-4965-b1d4-579440e7aaf6 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:37.016446 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-f59e4f3c-4eba-4965-b1d4-579440e7aaf6 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:37.016887 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-f59e4f3c-4eba-4965-b1d4-579440e7aaf6 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:37.017585 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-f59e4f3c-4eba-4965-b1d4-579440e7aaf6 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:37.018090 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-f59e4f3c-4eba-4965-b1d4-579440e7aaf6 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:37.018535 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-f59e4f3c-4eba-4965-b1d4-579440e7aaf6 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:37.150494 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-f59e4f3c-4eba-4965-b1d4-579440e7aaf6 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ece6ca9374764214bac6263bd691bc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9c317b548b40deb8cb27236d36d674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:21:37.158294 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-f59e4f3c-4eba-4965-b1d4-579440e7aaf6 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] 10.222.0.16 "GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe" status: 200 len: 1547 microversion: 2.1 time: 0.152749 Oct 31 19:21:37.158857 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 63/128] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:21:37 2022] GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe => generated 1547 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:21:37.185788 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-3634694e-4861-421a-bd95-1c5768a33615 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:21:37.186271 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-3634694e-4861-421a-bd95-1c5768a33615 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] [instance: 0a122a08-bc0f-40fd-8139-74c9e8a70ebe] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:21:37.192058 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-3634694e-4861-421a-bd95-1c5768a33615 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:37.192535 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-3634694e-4861-421a-bd95-1c5768a33615 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:37.192961 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-3634694e-4861-421a-bd95-1c5768a33615 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:37.193649 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-3634694e-4861-421a-bd95-1c5768a33615 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:37.194099 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-3634694e-4861-421a-bd95-1c5768a33615 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:37.194511 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-3634694e-4861-421a-bd95-1c5768a33615 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:37.276249 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-3634694e-4861-421a-bd95-1c5768a33615 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] 10.222.0.16 "GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094568 Oct 31 19:21:37.276844 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 66/129] 10.222.0.16 () {58 vars in 1275 bytes} [Mon Oct 31 19:21:37 2022] GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:21:37.498948 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-034072d2-222b-4e24-924c-df26b82f0ac9 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:21:37.499566 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-034072d2-222b-4e24-924c-df26b82f0ac9 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] [instance: 98a9a544-4553-4083-aa26-1dc327369d54] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:21:37.505513 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-034072d2-222b-4e24-924c-df26b82f0ac9 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:37.506028 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-034072d2-222b-4e24-924c-df26b82f0ac9 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:37.506479 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-034072d2-222b-4e24-924c-df26b82f0ac9 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:37.507157 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-034072d2-222b-4e24-924c-df26b82f0ac9 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:37.507612 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-034072d2-222b-4e24-924c-df26b82f0ac9 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:37.508038 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-034072d2-222b-4e24-924c-df26b82f0ac9 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:37.524201 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG dbcounter [-] [118727] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:21:37.656973 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-034072d2-222b-4e24-924c-df26b82f0ac9 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af27927be0e249bfb320652152f501bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c549a25d33441e98aae78e940a69c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:21:37.669213 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-034072d2-222b-4e24-924c-df26b82f0ac9 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] 10.222.0.16 "GET /compute/v2.1/servers/98a9a544-4553-4083-aa26-1dc327369d54" status: 200 len: 1314 microversion: 2.1 time: 0.173994 Oct 31 19:21:37.673746 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 64/130] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:21:37 2022] GET /compute/v2.1/servers/98a9a544-4553-4083-aa26-1dc327369d54 => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:21:37.742360 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-82fc2e01-473c-4cf4-803b-0228aa0f41dd tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:21:37.743833 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-82fc2e01-473c-4cf4-803b-0228aa0f41dd tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 37698c73-94da-4904-a8d5-636936092fba] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:21:37.750993 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-82fc2e01-473c-4cf4-803b-0228aa0f41dd tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:37.751662 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-82fc2e01-473c-4cf4-803b-0228aa0f41dd tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:37.752345 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-82fc2e01-473c-4cf4-803b-0228aa0f41dd tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:37.753033 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-82fc2e01-473c-4cf4-803b-0228aa0f41dd tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:37.753645 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-82fc2e01-473c-4cf4-803b-0228aa0f41dd tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:37.754279 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-82fc2e01-473c-4cf4-803b-0228aa0f41dd tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:38.119024 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-82fc2e01-473c-4cf4-803b-0228aa0f41dd tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc49f9eb3114759b2889ed8972136d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cf63c76fc543428404002ae9a75b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:21:38.127003 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-82fc2e01-473c-4cf4-803b-0228aa0f41dd tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/37698c73-94da-4904-a8d5-636936092fba" status: 200 len: 1520 microversion: 2.1 time: 0.389165 Oct 31 19:21:38.127596 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 67/131] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:21:37 2022] GET /compute/v2.1/servers/37698c73-94da-4904-a8d5-636936092fba => generated 1520 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:21:38.692122 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-1571a18a-5dd2-44b9-8ed6-b246cb537398 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:21:38.692724 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-1571a18a-5dd2-44b9-8ed6-b246cb537398 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] [instance: 98a9a544-4553-4083-aa26-1dc327369d54] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:21:38.698587 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-1571a18a-5dd2-44b9-8ed6-b246cb537398 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:38.699061 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-1571a18a-5dd2-44b9-8ed6-b246cb537398 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:38.699487 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-1571a18a-5dd2-44b9-8ed6-b246cb537398 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:38.700167 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-1571a18a-5dd2-44b9-8ed6-b246cb537398 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:38.700622 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-1571a18a-5dd2-44b9-8ed6-b246cb537398 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:38.701035 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-1571a18a-5dd2-44b9-8ed6-b246cb537398 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:38.832674 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-1571a18a-5dd2-44b9-8ed6-b246cb537398 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af27927be0e249bfb320652152f501bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c549a25d33441e98aae78e940a69c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:21:38.840794 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-1571a18a-5dd2-44b9-8ed6-b246cb537398 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] 10.222.0.16 "GET /compute/v2.1/servers/98a9a544-4553-4083-aa26-1dc327369d54" status: 200 len: 1501 microversion: 2.1 time: 0.153046 Oct 31 19:21:38.841411 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 65/132] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:21:38 2022] GET /compute/v2.1/servers/98a9a544-4553-4083-aa26-1dc327369d54 => generated 1501 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:21:38.942992 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [req-1c339d2d-1c87-42b4-96d9-20410569ef92 req-c9d5b0a5-d4f6-4d58-87ff-456c0de764af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a122a08-bc0f-40fd-8139-74c9e8a70ebe", "tag": "810ffdd3-13de-43d5-a09c-221911cc3bcf"}]} {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:21:38.961436 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [req-1c339d2d-1c87-42b4-96d9-20410569ef92 req-c9d5b0a5-d4f6-4d58-87ff-456c0de764af service nova] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:38.962245 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [req-1c339d2d-1c87-42b4-96d9-20410569ef92 req-c9d5b0a5-d4f6-4d58-87ff-456c0de764af service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:38.962694 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [req-1c339d2d-1c87-42b4-96d9-20410569ef92 req-c9d5b0a5-d4f6-4d58-87ff-456c0de764af service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:38.974389 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.compute.server_external_events [req-1c339d2d-1c87-42b4-96d9-20410569ef92 req-c9d5b0a5-d4f6-4d58-87ff-456c0de764af service nova] Creating event network-changed:810ffdd3-13de-43d5-a09c-221911cc3bcf for instance 0a122a08-bc0f-40fd-8139-74c9e8a70ebe on hv-cinder-86309 Oct 31 19:21:38.979890 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [req-1c339d2d-1c87-42b4-96d9-20410569ef92 req-c9d5b0a5-d4f6-4d58-87ff-456c0de764af service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041102 Oct 31 19:21:38.980783 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 68/133] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 31 19:21:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:21:39.152202 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-a5dcea4c-422d-42cd-94d7-037a1f251ee2 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:21:39.152950 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-a5dcea4c-422d-42cd-94d7-037a1f251ee2 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 37698c73-94da-4904-a8d5-636936092fba] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:21:39.162020 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-a5dcea4c-422d-42cd-94d7-037a1f251ee2 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:39.162843 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-a5dcea4c-422d-42cd-94d7-037a1f251ee2 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:39.163368 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-a5dcea4c-422d-42cd-94d7-037a1f251ee2 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:39.164180 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-a5dcea4c-422d-42cd-94d7-037a1f251ee2 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:39.165122 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-a5dcea4c-422d-42cd-94d7-037a1f251ee2 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:39.165664 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-a5dcea4c-422d-42cd-94d7-037a1f251ee2 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:39.313219 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-a5dcea4c-422d-42cd-94d7-037a1f251ee2 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc49f9eb3114759b2889ed8972136d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cf63c76fc543428404002ae9a75b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:21:39.321477 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-a5dcea4c-422d-42cd-94d7-037a1f251ee2 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/37698c73-94da-4904-a8d5-636936092fba" status: 200 len: 1520 microversion: 2.1 time: 0.174185 Oct 31 19:21:39.322080 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 66/134] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:21:39 2022] GET /compute/v2.1/servers/37698c73-94da-4904-a8d5-636936092fba => generated 1520 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:21:40.344797 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-039db806-88ca-40d6-bc47-bb227ebe1f59 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:21:40.345487 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-039db806-88ca-40d6-bc47-bb227ebe1f59 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 37698c73-94da-4904-a8d5-636936092fba] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:21:40.351540 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-039db806-88ca-40d6-bc47-bb227ebe1f59 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:40.352015 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-039db806-88ca-40d6-bc47-bb227ebe1f59 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:40.352445 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-039db806-88ca-40d6-bc47-bb227ebe1f59 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:40.353116 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-039db806-88ca-40d6-bc47-bb227ebe1f59 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:40.353560 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-039db806-88ca-40d6-bc47-bb227ebe1f59 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:40.354000 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-039db806-88ca-40d6-bc47-bb227ebe1f59 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:40.481508 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-039db806-88ca-40d6-bc47-bb227ebe1f59 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc49f9eb3114759b2889ed8972136d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cf63c76fc543428404002ae9a75b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:21:40.489571 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-039db806-88ca-40d6-bc47-bb227ebe1f59 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/37698c73-94da-4904-a8d5-636936092fba" status: 200 len: 1520 microversion: 2.1 time: 0.149115 Oct 31 19:21:40.490157 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 69/135] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:21:40 2022] GET /compute/v2.1/servers/37698c73-94da-4904-a8d5-636936092fba => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:21:41.513239 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-cdd95628-c81b-4225-b388-5519e13a7e87 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:21:41.513872 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-cdd95628-c81b-4225-b388-5519e13a7e87 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 37698c73-94da-4904-a8d5-636936092fba] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:21:41.519950 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-cdd95628-c81b-4225-b388-5519e13a7e87 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:41.520425 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-cdd95628-c81b-4225-b388-5519e13a7e87 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:41.520857 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-cdd95628-c81b-4225-b388-5519e13a7e87 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:41.521532 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-cdd95628-c81b-4225-b388-5519e13a7e87 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:41.522007 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-cdd95628-c81b-4225-b388-5519e13a7e87 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:41.522422 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-cdd95628-c81b-4225-b388-5519e13a7e87 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:41.653193 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-cdd95628-c81b-4225-b388-5519e13a7e87 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc49f9eb3114759b2889ed8972136d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cf63c76fc543428404002ae9a75b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:21:41.661321 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-cdd95628-c81b-4225-b388-5519e13a7e87 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/37698c73-94da-4904-a8d5-636936092fba" status: 200 len: 1520 microversion: 2.1 time: 0.151937 Oct 31 19:21:41.661933 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 67/136] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:21:41 2022] GET /compute/v2.1/servers/37698c73-94da-4904-a8d5-636936092fba => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:21:42.357478 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-bf4956a1-46f2-40ee-8e7a-723b5237869f tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "39ccdad4-c8e0-42bc-80a2-04e712857d97"}} {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:21:42.360094 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-bf4956a1-46f2-40ee-8e7a-723b5237869f tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] [instance: 98a9a544-4553-4083-aa26-1dc327369d54] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:21:42.366554 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-bf4956a1-46f2-40ee-8e7a-723b5237869f tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:42.367053 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-bf4956a1-46f2-40ee-8e7a-723b5237869f tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:42.367593 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-bf4956a1-46f2-40ee-8e7a-723b5237869f tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:42.368159 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-bf4956a1-46f2-40ee-8e7a-723b5237869f tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:42.368619 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-bf4956a1-46f2-40ee-8e7a-723b5237869f tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:42.369012 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-bf4956a1-46f2-40ee-8e7a-723b5237869f tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:42.708634 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-d0c75c1d-29cb-401f-af7b-5855bd839863 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:21:42.714477 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-d0c75c1d-29cb-401f-af7b-5855bd839863 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 37698c73-94da-4904-a8d5-636936092fba] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:21:42.751845 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-d0c75c1d-29cb-401f-af7b-5855bd839863 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:42.759170 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-d0c75c1d-29cb-401f-af7b-5855bd839863 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:42.763296 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-d0c75c1d-29cb-401f-af7b-5855bd839863 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:42.764461 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-d0c75c1d-29cb-401f-af7b-5855bd839863 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:42.768424 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-d0c75c1d-29cb-401f-af7b-5855bd839863 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:42.777189 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-d0c75c1d-29cb-401f-af7b-5855bd839863 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:43.071531 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-d0c75c1d-29cb-401f-af7b-5855bd839863 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc49f9eb3114759b2889ed8972136d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cf63c76fc543428404002ae9a75b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:21:43.082720 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-d0c75c1d-29cb-401f-af7b-5855bd839863 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/37698c73-94da-4904-a8d5-636936092fba" status: 200 len: 1520 microversion: 2.1 time: 0.394363 Oct 31 19:21:43.083280 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 68/137] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:21:42 2022] GET /compute/v2.1/servers/37698c73-94da-4904-a8d5-636936092fba => generated 1520 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:21:43.478684 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-bf4956a1-46f2-40ee-8e7a-723b5237869f tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] 10.222.0.16 "POST /compute/v2.1/servers/98a9a544-4553-4083-aa26-1dc327369d54/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.125013 Oct 31 19:21:43.479275 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 70/138] 10.222.0.16 () {60 vars in 1323 bytes} [Mon Oct 31 19:21:42 2022] POST /compute/v2.1/servers/98a9a544-4553-4083-aa26-1dc327369d54/os-volume_attachments => generated 194 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:21:44.106495 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-d8437d28-318f-4a0e-a319-0eb4592cbb61 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:21:44.107237 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-d8437d28-318f-4a0e-a319-0eb4592cbb61 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 37698c73-94da-4904-a8d5-636936092fba] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:21:44.113800 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-d8437d28-318f-4a0e-a319-0eb4592cbb61 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:44.114357 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-d8437d28-318f-4a0e-a319-0eb4592cbb61 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:44.114967 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-d8437d28-318f-4a0e-a319-0eb4592cbb61 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:44.115653 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-d8437d28-318f-4a0e-a319-0eb4592cbb61 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:44.117304 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-d8437d28-318f-4a0e-a319-0eb4592cbb61 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:44.117304 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-d8437d28-318f-4a0e-a319-0eb4592cbb61 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:44.257144 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-d8437d28-318f-4a0e-a319-0eb4592cbb61 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc49f9eb3114759b2889ed8972136d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cf63c76fc543428404002ae9a75b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:21:44.264937 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-d8437d28-318f-4a0e-a319-0eb4592cbb61 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/37698c73-94da-4904-a8d5-636936092fba" status: 200 len: 1520 microversion: 2.1 time: 0.162378 Oct 31 19:21:44.265415 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 69/139] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:21:44 2022] GET /compute/v2.1/servers/37698c73-94da-4904-a8d5-636936092fba => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:21:45.288732 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-04e6ff55-2cad-4d56-bc44-8d564be8a700 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:21:45.289427 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-04e6ff55-2cad-4d56-bc44-8d564be8a700 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 37698c73-94da-4904-a8d5-636936092fba] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:21:45.297329 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-04e6ff55-2cad-4d56-bc44-8d564be8a700 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:45.297329 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-04e6ff55-2cad-4d56-bc44-8d564be8a700 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:45.297329 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-04e6ff55-2cad-4d56-bc44-8d564be8a700 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:45.297995 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-04e6ff55-2cad-4d56-bc44-8d564be8a700 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:45.298447 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-04e6ff55-2cad-4d56-bc44-8d564be8a700 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:45.298868 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-04e6ff55-2cad-4d56-bc44-8d564be8a700 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:45.434954 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-04e6ff55-2cad-4d56-bc44-8d564be8a700 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc49f9eb3114759b2889ed8972136d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cf63c76fc543428404002ae9a75b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:21:45.443077 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-04e6ff55-2cad-4d56-bc44-8d564be8a700 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/37698c73-94da-4904-a8d5-636936092fba" status: 200 len: 1520 microversion: 2.1 time: 0.159830 Oct 31 19:21:45.443638 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 71/140] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:21:45 2022] GET /compute/v2.1/servers/37698c73-94da-4904-a8d5-636936092fba => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:21:46.471693 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-972b0528-2e76-4af5-bc11-e11808f8d363 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:21:46.472443 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-972b0528-2e76-4af5-bc11-e11808f8d363 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 37698c73-94da-4904-a8d5-636936092fba] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:21:46.479160 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-972b0528-2e76-4af5-bc11-e11808f8d363 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:46.479712 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-972b0528-2e76-4af5-bc11-e11808f8d363 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:46.480362 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-972b0528-2e76-4af5-bc11-e11808f8d363 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:46.481251 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-972b0528-2e76-4af5-bc11-e11808f8d363 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:46.481726 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-972b0528-2e76-4af5-bc11-e11808f8d363 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:46.482146 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-972b0528-2e76-4af5-bc11-e11808f8d363 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:46.780192 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-972b0528-2e76-4af5-bc11-e11808f8d363 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc49f9eb3114759b2889ed8972136d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cf63c76fc543428404002ae9a75b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:21:46.787978 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-972b0528-2e76-4af5-bc11-e11808f8d363 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/37698c73-94da-4904-a8d5-636936092fba" status: 200 len: 1520 microversion: 2.1 time: 0.320897 Oct 31 19:21:46.788548 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 70/141] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:21:46 2022] GET /compute/v2.1/servers/37698c73-94da-4904-a8d5-636936092fba => generated 1520 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:21:47.815859 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-784df4fc-dfcc-4a7b-9149-7e106e0aaae4 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:21:47.816986 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-784df4fc-dfcc-4a7b-9149-7e106e0aaae4 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 37698c73-94da-4904-a8d5-636936092fba] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:21:47.823199 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-784df4fc-dfcc-4a7b-9149-7e106e0aaae4 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:47.823674 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-784df4fc-dfcc-4a7b-9149-7e106e0aaae4 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:47.824101 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-784df4fc-dfcc-4a7b-9149-7e106e0aaae4 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:47.824775 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-784df4fc-dfcc-4a7b-9149-7e106e0aaae4 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:47.825224 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-784df4fc-dfcc-4a7b-9149-7e106e0aaae4 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:47.825765 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-784df4fc-dfcc-4a7b-9149-7e106e0aaae4 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:47.975654 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-784df4fc-dfcc-4a7b-9149-7e106e0aaae4 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc49f9eb3114759b2889ed8972136d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cf63c76fc543428404002ae9a75b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:21:47.983123 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-784df4fc-dfcc-4a7b-9149-7e106e0aaae4 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/37698c73-94da-4904-a8d5-636936092fba" status: 200 len: 1520 microversion: 2.1 time: 0.170987 Oct 31 19:21:47.983689 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 72/142] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:21:47 2022] GET /compute/v2.1/servers/37698c73-94da-4904-a8d5-636936092fba => generated 1520 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:21:49.006215 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-ca8fe410-8ff9-4a90-b611-2d9471961c8c tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:21:49.007809 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-ca8fe410-8ff9-4a90-b611-2d9471961c8c tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 37698c73-94da-4904-a8d5-636936092fba] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:21:49.027783 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-ca8fe410-8ff9-4a90-b611-2d9471961c8c tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:49.029811 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-ca8fe410-8ff9-4a90-b611-2d9471961c8c tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:49.030522 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-ca8fe410-8ff9-4a90-b611-2d9471961c8c tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:49.031544 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-ca8fe410-8ff9-4a90-b611-2d9471961c8c tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:49.032241 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-ca8fe410-8ff9-4a90-b611-2d9471961c8c tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:49.032883 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-ca8fe410-8ff9-4a90-b611-2d9471961c8c tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:49.288238 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-ca8fe410-8ff9-4a90-b611-2d9471961c8c tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc49f9eb3114759b2889ed8972136d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cf63c76fc543428404002ae9a75b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:21:49.297029 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-ca8fe410-8ff9-4a90-b611-2d9471961c8c tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/37698c73-94da-4904-a8d5-636936092fba" status: 200 len: 1520 microversion: 2.1 time: 0.295153 Oct 31 19:21:49.297823 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 71/143] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:21:49 2022] GET /compute/v2.1/servers/37698c73-94da-4904-a8d5-636936092fba => generated 1520 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:21:50.322878 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-bdcea7fd-723e-4367-ba27-324956de9633 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:21:50.323487 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-bdcea7fd-723e-4367-ba27-324956de9633 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 37698c73-94da-4904-a8d5-636936092fba] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:21:50.325979 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG dbcounter [-] [118726] Writing DB stats nova_api:SELECT=70 {{(pid=118726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:21:50.331317 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-bdcea7fd-723e-4367-ba27-324956de9633 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:50.332361 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-bdcea7fd-723e-4367-ba27-324956de9633 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:50.332800 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-bdcea7fd-723e-4367-ba27-324956de9633 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:50.333500 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-bdcea7fd-723e-4367-ba27-324956de9633 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:50.334136 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-bdcea7fd-723e-4367-ba27-324956de9633 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:50.334586 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-bdcea7fd-723e-4367-ba27-324956de9633 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:50.469557 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-bdcea7fd-723e-4367-ba27-324956de9633 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc49f9eb3114759b2889ed8972136d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cf63c76fc543428404002ae9a75b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:21:50.478027 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-bdcea7fd-723e-4367-ba27-324956de9633 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/37698c73-94da-4904-a8d5-636936092fba" status: 200 len: 1520 microversion: 2.1 time: 0.159436 Oct 31 19:21:50.478591 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 73/144] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:21:50 2022] GET /compute/v2.1/servers/37698c73-94da-4904-a8d5-636936092fba => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:21:50.505937 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-23ebb675-4d22-4319-b666-0c12eafd6764 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1573507953", "imageRef": "a9795ee0-6722-4e1e-8fc8-a6c2e68f3049", "flavorRef": "452"}} {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:21:50.557634 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.network.neutron [None req-23ebb675-4d22-4319-b666-0c12eafd6764 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] validate_networks() for None {{(pid=118727) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 19:21:51.006291 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.virt.hardware [None req-23ebb675-4d22-4319-b666-0c12eafd6764 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Flavor limits 0:0:0 {{(pid=118727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 19:21:51.006706 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.virt.hardware [None req-23ebb675-4d22-4319-b666-0c12eafd6764 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Image limits 0:0:0 {{(pid=118727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 19:21:51.007167 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.virt.hardware [None req-23ebb675-4d22-4319-b666-0c12eafd6764 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Flavor pref 0:0:0 {{(pid=118727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 19:21:51.007566 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.virt.hardware [None req-23ebb675-4d22-4319-b666-0c12eafd6764 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Image pref 0:0:0 {{(pid=118727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 19:21:51.007967 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.virt.hardware [None req-23ebb675-4d22-4319-b666-0c12eafd6764 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 19:21:51.016593 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-23ebb675-4d22-4319-b666-0c12eafd6764 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:51.017068 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-23ebb675-4d22-4319-b666-0c12eafd6764 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:51.017496 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-23ebb675-4d22-4319-b666-0c12eafd6764 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:51.018241 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-23ebb675-4d22-4319-b666-0c12eafd6764 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:51.018697 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-23ebb675-4d22-4319-b666-0c12eafd6764 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:51.020408 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-23ebb675-4d22-4319-b666-0c12eafd6764 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:51.037299 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.quota [None req-23ebb675-4d22-4319-b666-0c12eafd6764 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Getting quotas for project f19afdd98f2e4f49935bc8f8cf0211d4. Resources: {'instances', 'ram', 'cores'} {{(pid=118727) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 19:21:51.041299 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.quota [None req-23ebb675-4d22-4319-b666-0c12eafd6764 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Getting quotas for user f250770909504592978a8d8c9fb7d668 and project f19afdd98f2e4f49935bc8f8cf0211d4. Resources: {'instances', 'ram', 'cores'} {{(pid=118727) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 19:21:51.053232 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-23ebb675-4d22-4319-b666-0c12eafd6764 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Going to run 1 instances... {{(pid=118727) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 19:21:51.055633 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-23ebb675-4d22-4319-b666-0c12eafd6764 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] [instance: 005f4b9f-db45-4bed-9eba-55b70d6b2229] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9795ee0-6722-4e1e-8fc8-a6c2e68f3049',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118727) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 19:21:51.099888 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-23ebb675-4d22-4319-b666-0c12eafd6764 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.597907 Oct 31 19:21:51.100525 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 72/145] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 31 19:21:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 599 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 19:21:51.111555 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-5f1d1883-1b6a-4408-8535-cf00addd0941 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:21:51.112166 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-5f1d1883-1b6a-4408-8535-cf00addd0941 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] [instance: 005f4b9f-db45-4bed-9eba-55b70d6b2229] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:21:51.164888 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-5f1d1883-1b6a-4408-8535-cf00addd0941 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f250770909504592978a8d8c9fb7d668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f19afdd98f2e4f49935bc8f8cf0211d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:21:51.175928 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-5f1d1883-1b6a-4408-8535-cf00addd0941 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] 10.222.0.16 "GET /compute/v2.1/servers/005f4b9f-db45-4bed-9eba-55b70d6b2229" status: 200 len: 1215 microversion: 2.1 time: 0.067394 Oct 31 19:21:51.176522 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 74/146] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:21:51 2022] GET /compute/v2.1/servers/005f4b9f-db45-4bed-9eba-55b70d6b2229 => generated 1215 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:21:51.501719 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-05ee81be-88ea-47fc-993d-73e3fcf03433 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:21:51.502915 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-05ee81be-88ea-47fc-993d-73e3fcf03433 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 37698c73-94da-4904-a8d5-636936092fba] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:21:51.513334 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-05ee81be-88ea-47fc-993d-73e3fcf03433 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:51.514711 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-05ee81be-88ea-47fc-993d-73e3fcf03433 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:51.515434 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-05ee81be-88ea-47fc-993d-73e3fcf03433 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:51.516306 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-05ee81be-88ea-47fc-993d-73e3fcf03433 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:51.516903 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-05ee81be-88ea-47fc-993d-73e3fcf03433 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:51.517493 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-05ee81be-88ea-47fc-993d-73e3fcf03433 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:51.730909 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-05ee81be-88ea-47fc-993d-73e3fcf03433 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc49f9eb3114759b2889ed8972136d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cf63c76fc543428404002ae9a75b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:21:51.740354 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-05ee81be-88ea-47fc-993d-73e3fcf03433 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/37698c73-94da-4904-a8d5-636936092fba" status: 200 len: 1520 microversion: 2.1 time: 0.243717 Oct 31 19:21:51.741014 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 73/147] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:21:51 2022] GET /compute/v2.1/servers/37698c73-94da-4904-a8d5-636936092fba => generated 1520 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:21:52.198705 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-f77b95e2-3dec-4981-a055-0fa8a50c30ce tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:21:52.199598 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-f77b95e2-3dec-4981-a055-0fa8a50c30ce tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] [instance: 005f4b9f-db45-4bed-9eba-55b70d6b2229] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:21:52.207782 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-f77b95e2-3dec-4981-a055-0fa8a50c30ce tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:52.208495 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-f77b95e2-3dec-4981-a055-0fa8a50c30ce tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:52.208987 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-f77b95e2-3dec-4981-a055-0fa8a50c30ce tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:52.209851 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-f77b95e2-3dec-4981-a055-0fa8a50c30ce tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:52.210367 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-f77b95e2-3dec-4981-a055-0fa8a50c30ce tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:52.210886 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-f77b95e2-3dec-4981-a055-0fa8a50c30ce tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:52.280720 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-f77b95e2-3dec-4981-a055-0fa8a50c30ce tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f250770909504592978a8d8c9fb7d668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f19afdd98f2e4f49935bc8f8cf0211d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:21:52.289284 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-f77b95e2-3dec-4981-a055-0fa8a50c30ce tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] 10.222.0.16 "GET /compute/v2.1/servers/005f4b9f-db45-4bed-9eba-55b70d6b2229" status: 200 len: 1267 microversion: 2.1 time: 0.094461 Oct 31 19:21:52.292405 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 75/148] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:21:52 2022] GET /compute/v2.1/servers/005f4b9f-db45-4bed-9eba-55b70d6b2229 => generated 1267 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:21:52.763899 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-70b83daf-5772-4d7e-8b36-1cc9130d702f tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:21:52.764520 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-70b83daf-5772-4d7e-8b36-1cc9130d702f tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 37698c73-94da-4904-a8d5-636936092fba] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:21:52.773092 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-70b83daf-5772-4d7e-8b36-1cc9130d702f tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:52.774000 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-70b83daf-5772-4d7e-8b36-1cc9130d702f tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:52.774958 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-70b83daf-5772-4d7e-8b36-1cc9130d702f tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:52.776030 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-70b83daf-5772-4d7e-8b36-1cc9130d702f tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:52.778244 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-70b83daf-5772-4d7e-8b36-1cc9130d702f tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:52.778943 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-70b83daf-5772-4d7e-8b36-1cc9130d702f tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:52.929897 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-70b83daf-5772-4d7e-8b36-1cc9130d702f tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc49f9eb3114759b2889ed8972136d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cf63c76fc543428404002ae9a75b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:21:52.939563 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-70b83daf-5772-4d7e-8b36-1cc9130d702f tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/37698c73-94da-4904-a8d5-636936092fba" status: 200 len: 1520 microversion: 2.1 time: 0.179519 Oct 31 19:21:52.940223 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 74/149] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:21:52 2022] GET /compute/v2.1/servers/37698c73-94da-4904-a8d5-636936092fba => generated 1520 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:21:53.314787 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-3d24abb8-1847-49b9-a1f5-cb9ac4a03688 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:21:53.315482 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-3d24abb8-1847-49b9-a1f5-cb9ac4a03688 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] [instance: 005f4b9f-db45-4bed-9eba-55b70d6b2229] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:21:53.321418 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-3d24abb8-1847-49b9-a1f5-cb9ac4a03688 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:53.322007 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-3d24abb8-1847-49b9-a1f5-cb9ac4a03688 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:53.322572 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-3d24abb8-1847-49b9-a1f5-cb9ac4a03688 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:53.323463 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-3d24abb8-1847-49b9-a1f5-cb9ac4a03688 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:53.323991 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-3d24abb8-1847-49b9-a1f5-cb9ac4a03688 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:53.324524 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-3d24abb8-1847-49b9-a1f5-cb9ac4a03688 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:53.398475 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-3d24abb8-1847-49b9-a1f5-cb9ac4a03688 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f250770909504592978a8d8c9fb7d668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f19afdd98f2e4f49935bc8f8cf0211d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:21:53.406272 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-3d24abb8-1847-49b9-a1f5-cb9ac4a03688 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] 10.222.0.16 "GET /compute/v2.1/servers/005f4b9f-db45-4bed-9eba-55b70d6b2229" status: 200 len: 1275 microversion: 2.1 time: 0.095824 Oct 31 19:21:53.406820 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 76/150] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:21:53 2022] GET /compute/v2.1/servers/005f4b9f-db45-4bed-9eba-55b70d6b2229 => generated 1275 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:21:53.963532 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-b8146ffb-e7c3-4a14-81d9-371cced181d8 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:21:53.964136 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-b8146ffb-e7c3-4a14-81d9-371cced181d8 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 37698c73-94da-4904-a8d5-636936092fba] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:21:53.970163 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-b8146ffb-e7c3-4a14-81d9-371cced181d8 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:53.970638 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-b8146ffb-e7c3-4a14-81d9-371cced181d8 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:53.971061 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-b8146ffb-e7c3-4a14-81d9-371cced181d8 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:53.971736 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-b8146ffb-e7c3-4a14-81d9-371cced181d8 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:53.972756 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-b8146ffb-e7c3-4a14-81d9-371cced181d8 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:53.973182 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-b8146ffb-e7c3-4a14-81d9-371cced181d8 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:54.103876 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-b8146ffb-e7c3-4a14-81d9-371cced181d8 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc49f9eb3114759b2889ed8972136d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cf63c76fc543428404002ae9a75b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:21:54.111964 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-b8146ffb-e7c3-4a14-81d9-371cced181d8 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/37698c73-94da-4904-a8d5-636936092fba" status: 200 len: 1520 microversion: 2.1 time: 0.151745 Oct 31 19:21:54.111964 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 75/151] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:21:53 2022] GET /compute/v2.1/servers/37698c73-94da-4904-a8d5-636936092fba => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:21:54.429705 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-327feeba-df04-4ad7-a90e-cdc223702d08 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:21:54.430266 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-327feeba-df04-4ad7-a90e-cdc223702d08 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] [instance: 005f4b9f-db45-4bed-9eba-55b70d6b2229] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:21:54.436574 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-327feeba-df04-4ad7-a90e-cdc223702d08 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:54.437051 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-327feeba-df04-4ad7-a90e-cdc223702d08 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:54.437479 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-327feeba-df04-4ad7-a90e-cdc223702d08 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:54.438292 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-327feeba-df04-4ad7-a90e-cdc223702d08 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:54.438755 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-327feeba-df04-4ad7-a90e-cdc223702d08 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:54.439313 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-327feeba-df04-4ad7-a90e-cdc223702d08 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:54.509229 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-327feeba-df04-4ad7-a90e-cdc223702d08 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f250770909504592978a8d8c9fb7d668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f19afdd98f2e4f49935bc8f8cf0211d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:21:54.517914 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-327feeba-df04-4ad7-a90e-cdc223702d08 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] 10.222.0.16 "GET /compute/v2.1/servers/005f4b9f-db45-4bed-9eba-55b70d6b2229" status: 200 len: 1275 microversion: 2.1 time: 0.092185 Oct 31 19:21:54.518492 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 77/152] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:21:54 2022] GET /compute/v2.1/servers/005f4b9f-db45-4bed-9eba-55b70d6b2229 => generated 1275 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:21:55.136295 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-56bb7dc9-cedd-4b32-9d14-5324b5a82ae3 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:21:55.137013 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-56bb7dc9-cedd-4b32-9d14-5324b5a82ae3 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 37698c73-94da-4904-a8d5-636936092fba] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:21:55.152293 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-56bb7dc9-cedd-4b32-9d14-5324b5a82ae3 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:55.152945 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-56bb7dc9-cedd-4b32-9d14-5324b5a82ae3 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:55.156638 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-56bb7dc9-cedd-4b32-9d14-5324b5a82ae3 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:55.157565 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-56bb7dc9-cedd-4b32-9d14-5324b5a82ae3 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:55.158546 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-56bb7dc9-cedd-4b32-9d14-5324b5a82ae3 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:55.159079 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-56bb7dc9-cedd-4b32-9d14-5324b5a82ae3 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:55.432493 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-56bb7dc9-cedd-4b32-9d14-5324b5a82ae3 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc49f9eb3114759b2889ed8972136d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cf63c76fc543428404002ae9a75b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:21:55.443559 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-56bb7dc9-cedd-4b32-9d14-5324b5a82ae3 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/37698c73-94da-4904-a8d5-636936092fba" status: 200 len: 1520 microversion: 2.1 time: 0.311068 Oct 31 19:21:55.452416 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 76/153] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:21:55 2022] GET /compute/v2.1/servers/37698c73-94da-4904-a8d5-636936092fba => generated 1520 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:21:55.466337 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-8f888441-8f89-4aa0-9b0c-34e5dd8b276e tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:21:55.466868 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-8f888441-8f89-4aa0-9b0c-34e5dd8b276e tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] [instance: 98a9a544-4553-4083-aa26-1dc327369d54] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:21:55.477900 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-8f888441-8f89-4aa0-9b0c-34e5dd8b276e tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:55.478640 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-8f888441-8f89-4aa0-9b0c-34e5dd8b276e tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:55.479245 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-8f888441-8f89-4aa0-9b0c-34e5dd8b276e tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:55.480326 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-8f888441-8f89-4aa0-9b0c-34e5dd8b276e tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:55.480935 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-8f888441-8f89-4aa0-9b0c-34e5dd8b276e tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:55.481425 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-8f888441-8f89-4aa0-9b0c-34e5dd8b276e tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:55.511274 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-8f888441-8f89-4aa0-9b0c-34e5dd8b276e tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] [instance: 98a9a544-4553-4083-aa26-1dc327369d54] Going to try to terminate instance {{(pid=118726) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 19:21:55.542489 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-c280615c-5ca3-4b3e-a688-58a719d96d77 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:21:55.544010 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-c280615c-5ca3-4b3e-a688-58a719d96d77 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] [instance: 005f4b9f-db45-4bed-9eba-55b70d6b2229] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:21:55.555154 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-c280615c-5ca3-4b3e-a688-58a719d96d77 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:55.558279 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-c280615c-5ca3-4b3e-a688-58a719d96d77 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:55.558825 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-c280615c-5ca3-4b3e-a688-58a719d96d77 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:55.559611 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-c280615c-5ca3-4b3e-a688-58a719d96d77 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:55.562296 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-c280615c-5ca3-4b3e-a688-58a719d96d77 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:55.562819 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-c280615c-5ca3-4b3e-a688-58a719d96d77 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:55.617182 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG dbcounter [-] [118726] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=118726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:21:55.678239 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-c280615c-5ca3-4b3e-a688-58a719d96d77 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f250770909504592978a8d8c9fb7d668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f19afdd98f2e4f49935bc8f8cf0211d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:21:55.689092 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-c280615c-5ca3-4b3e-a688-58a719d96d77 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] 10.222.0.16 "GET /compute/v2.1/servers/005f4b9f-db45-4bed-9eba-55b70d6b2229" status: 200 len: 1273 microversion: 2.1 time: 0.152031 Oct 31 19:21:55.693274 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 77/154] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:21:55 2022] GET /compute/v2.1/servers/005f4b9f-db45-4bed-9eba-55b70d6b2229 => generated 1273 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:21:55.731600 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-8f888441-8f89-4aa0-9b0c-34e5dd8b276e tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] 10.222.0.16 "DELETE /compute/v2.1/servers/98a9a544-4553-4083-aa26-1dc327369d54" status: 204 len: 0 microversion: 2.1 time: 0.270180 Oct 31 19:21:55.732314 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 78/155] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 31 19:21:55 2022] DELETE /compute/v2.1/servers/98a9a544-4553-4083-aa26-1dc327369d54 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 19:21:55.742073 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-741e9ea9-2328-4b03-a243-2b488978873e tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:21:55.742886 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-741e9ea9-2328-4b03-a243-2b488978873e tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] [instance: 98a9a544-4553-4083-aa26-1dc327369d54] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:21:55.750279 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-741e9ea9-2328-4b03-a243-2b488978873e tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:55.750939 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-741e9ea9-2328-4b03-a243-2b488978873e tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:55.751444 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-741e9ea9-2328-4b03-a243-2b488978873e tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:55.752373 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-741e9ea9-2328-4b03-a243-2b488978873e tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:55.752957 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-741e9ea9-2328-4b03-a243-2b488978873e tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:55.753569 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-741e9ea9-2328-4b03-a243-2b488978873e tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:56.008526 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-741e9ea9-2328-4b03-a243-2b488978873e tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af27927be0e249bfb320652152f501bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c549a25d33441e98aae78e940a69c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:21:56.016863 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-741e9ea9-2328-4b03-a243-2b488978873e tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] 10.222.0.16 "GET /compute/v2.1/servers/98a9a544-4553-4083-aa26-1dc327369d54" status: 200 len: 1553 microversion: 2.1 time: 0.280128 Oct 31 19:21:56.017681 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 78/156] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:21:55 2022] GET /compute/v2.1/servers/98a9a544-4553-4083-aa26-1dc327369d54 => generated 1553 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 19:21:56.477688 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-75db780b-ceb6-4dc6-bc4c-3154b7b9d4da tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:21:56.478395 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-75db780b-ceb6-4dc6-bc4c-3154b7b9d4da tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 37698c73-94da-4904-a8d5-636936092fba] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:21:56.484993 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-75db780b-ceb6-4dc6-bc4c-3154b7b9d4da tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:56.485472 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-75db780b-ceb6-4dc6-bc4c-3154b7b9d4da tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:56.485930 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-75db780b-ceb6-4dc6-bc4c-3154b7b9d4da tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:56.486618 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-75db780b-ceb6-4dc6-bc4c-3154b7b9d4da tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:56.487062 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-75db780b-ceb6-4dc6-bc4c-3154b7b9d4da tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:56.487478 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-75db780b-ceb6-4dc6-bc4c-3154b7b9d4da tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:56.633857 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-75db780b-ceb6-4dc6-bc4c-3154b7b9d4da tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc49f9eb3114759b2889ed8972136d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cf63c76fc543428404002ae9a75b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:21:56.643086 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-75db780b-ceb6-4dc6-bc4c-3154b7b9d4da tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/37698c73-94da-4904-a8d5-636936092fba" status: 200 len: 1520 microversion: 2.1 time: 0.177860 Oct 31 19:21:56.653303 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 79/157] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:21:56 2022] GET /compute/v2.1/servers/37698c73-94da-4904-a8d5-636936092fba => generated 1520 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:21:56.716244 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-8259c7a0-3020-4978-b395-04f139385ec5 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:21:56.716863 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-8259c7a0-3020-4978-b395-04f139385ec5 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] [instance: 005f4b9f-db45-4bed-9eba-55b70d6b2229] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:21:56.723915 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-8259c7a0-3020-4978-b395-04f139385ec5 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:56.724400 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-8259c7a0-3020-4978-b395-04f139385ec5 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:56.724834 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-8259c7a0-3020-4978-b395-04f139385ec5 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:56.725529 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-8259c7a0-3020-4978-b395-04f139385ec5 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:56.726075 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-8259c7a0-3020-4978-b395-04f139385ec5 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:56.726509 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-8259c7a0-3020-4978-b395-04f139385ec5 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:56.870975 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-8259c7a0-3020-4978-b395-04f139385ec5 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f250770909504592978a8d8c9fb7d668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f19afdd98f2e4f49935bc8f8cf0211d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:21:56.879061 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-8259c7a0-3020-4978-b395-04f139385ec5 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] 10.222.0.16 "GET /compute/v2.1/servers/005f4b9f-db45-4bed-9eba-55b70d6b2229" status: 200 len: 1315 microversion: 2.1 time: 0.166161 Oct 31 19:21:56.879635 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 79/158] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:21:56 2022] GET /compute/v2.1/servers/005f4b9f-db45-4bed-9eba-55b70d6b2229 => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:21:57.043367 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-0d9c1b52-60e4-4ebe-bc2c-379f5e18d7e8 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:21:57.043367 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-0d9c1b52-60e4-4ebe-bc2c-379f5e18d7e8 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] [instance: 98a9a544-4553-4083-aa26-1dc327369d54] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:21:57.048686 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-0d9c1b52-60e4-4ebe-bc2c-379f5e18d7e8 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:57.049196 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-0d9c1b52-60e4-4ebe-bc2c-379f5e18d7e8 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:57.049651 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-0d9c1b52-60e4-4ebe-bc2c-379f5e18d7e8 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:57.050390 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-0d9c1b52-60e4-4ebe-bc2c-379f5e18d7e8 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:57.050846 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-0d9c1b52-60e4-4ebe-bc2c-379f5e18d7e8 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:57.051271 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-0d9c1b52-60e4-4ebe-bc2c-379f5e18d7e8 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:57.190638 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-0d9c1b52-60e4-4ebe-bc2c-379f5e18d7e8 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af27927be0e249bfb320652152f501bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c549a25d33441e98aae78e940a69c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:21:57.199299 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-0d9c1b52-60e4-4ebe-bc2c-379f5e18d7e8 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] 10.222.0.16 "GET /compute/v2.1/servers/98a9a544-4553-4083-aa26-1dc327369d54" status: 200 len: 1553 microversion: 2.1 time: 0.162229 Oct 31 19:21:57.200038 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 80/159] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:21:57 2022] GET /compute/v2.1/servers/98a9a544-4553-4083-aa26-1dc327369d54 => generated 1553 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:21:57.666468 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-ad5a08f2-87f7-4c74-8964-5e5b1cfdf2d2 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:21:57.667253 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-ad5a08f2-87f7-4c74-8964-5e5b1cfdf2d2 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 37698c73-94da-4904-a8d5-636936092fba] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:21:57.673797 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-ad5a08f2-87f7-4c74-8964-5e5b1cfdf2d2 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:57.674268 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-ad5a08f2-87f7-4c74-8964-5e5b1cfdf2d2 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:57.674708 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-ad5a08f2-87f7-4c74-8964-5e5b1cfdf2d2 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:57.676000 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-ad5a08f2-87f7-4c74-8964-5e5b1cfdf2d2 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:57.676491 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-ad5a08f2-87f7-4c74-8964-5e5b1cfdf2d2 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:57.676919 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-ad5a08f2-87f7-4c74-8964-5e5b1cfdf2d2 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:57.903207 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-c8f5189b-5ba9-446f-9807-20dd4e01f6eb tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:21:57.904504 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-c8f5189b-5ba9-446f-9807-20dd4e01f6eb tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] [instance: 005f4b9f-db45-4bed-9eba-55b70d6b2229] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:21:57.920170 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-ad5a08f2-87f7-4c74-8964-5e5b1cfdf2d2 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc49f9eb3114759b2889ed8972136d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cf63c76fc543428404002ae9a75b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:21:57.925746 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-c8f5189b-5ba9-446f-9807-20dd4e01f6eb tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:57.930130 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-ad5a08f2-87f7-4c74-8964-5e5b1cfdf2d2 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/37698c73-94da-4904-a8d5-636936092fba" status: 200 len: 1520 microversion: 2.1 time: 0.267477 Oct 31 19:21:57.930328 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-c8f5189b-5ba9-446f-9807-20dd4e01f6eb tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:57.931021 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-c8f5189b-5ba9-446f-9807-20dd4e01f6eb tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:57.931326 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 80/160] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:21:57 2022] GET /compute/v2.1/servers/37698c73-94da-4904-a8d5-636936092fba => generated 1520 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:21:57.931920 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-c8f5189b-5ba9-446f-9807-20dd4e01f6eb tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:57.932384 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-c8f5189b-5ba9-446f-9807-20dd4e01f6eb tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:57.932813 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-c8f5189b-5ba9-446f-9807-20dd4e01f6eb tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:58.092022 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-c8f5189b-5ba9-446f-9807-20dd4e01f6eb tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f250770909504592978a8d8c9fb7d668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f19afdd98f2e4f49935bc8f8cf0211d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:21:58.105647 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-c8f5189b-5ba9-446f-9807-20dd4e01f6eb tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] 10.222.0.16 "GET /compute/v2.1/servers/005f4b9f-db45-4bed-9eba-55b70d6b2229" status: 200 len: 1315 microversion: 2.1 time: 0.206309 Oct 31 19:21:58.117960 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 81/161] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:21:57 2022] GET /compute/v2.1/servers/005f4b9f-db45-4bed-9eba-55b70d6b2229 => generated 1315 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 19:21:58.223102 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-b42ad749-c630-4caf-8332-3c9c4b8a1be5 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:21:58.223717 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-b42ad749-c630-4caf-8332-3c9c4b8a1be5 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] [instance: 98a9a544-4553-4083-aa26-1dc327369d54] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:21:58.230551 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-b42ad749-c630-4caf-8332-3c9c4b8a1be5 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:58.231036 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-b42ad749-c630-4caf-8332-3c9c4b8a1be5 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:58.231469 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-b42ad749-c630-4caf-8332-3c9c4b8a1be5 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:58.232322 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-b42ad749-c630-4caf-8332-3c9c4b8a1be5 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:58.232940 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-b42ad749-c630-4caf-8332-3c9c4b8a1be5 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:58.233518 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-b42ad749-c630-4caf-8332-3c9c4b8a1be5 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:58.564423 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [req-2eda04dc-1b10-4fae-80df-66b3ea22b268 req-a4f86308-8963-4a81-8b1f-7469d0001b4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "005f4b9f-db45-4bed-9eba-55b70d6b2229", "tag": "58080e2a-842b-4b20-bd5a-8cca7dca5e72"}]} {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:21:58.587417 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [req-2eda04dc-1b10-4fae-80df-66b3ea22b268 req-a4f86308-8963-4a81-8b1f-7469d0001b4a service nova] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:58.587914 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [req-2eda04dc-1b10-4fae-80df-66b3ea22b268 req-a4f86308-8963-4a81-8b1f-7469d0001b4a service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:58.588340 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [req-2eda04dc-1b10-4fae-80df-66b3ea22b268 req-a4f86308-8963-4a81-8b1f-7469d0001b4a service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:58.601143 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.compute.server_external_events [req-2eda04dc-1b10-4fae-80df-66b3ea22b268 req-a4f86308-8963-4a81-8b1f-7469d0001b4a service nova] Creating event network-changed:58080e2a-842b-4b20-bd5a-8cca7dca5e72 for instance 005f4b9f-db45-4bed-9eba-55b70d6b2229 on hv-cinder-86309 Oct 31 19:21:58.607628 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [req-2eda04dc-1b10-4fae-80df-66b3ea22b268 req-a4f86308-8963-4a81-8b1f-7469d0001b4a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047042 Oct 31 19:21:58.608853 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 82/162] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 31 19:21:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:21:58.682769 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-b42ad749-c630-4caf-8332-3c9c4b8a1be5 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af27927be0e249bfb320652152f501bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c549a25d33441e98aae78e940a69c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:21:58.685981 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG dbcounter [-] [118727] Writing DB stats nova_cell1:SELECT=100 {{(pid=118727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:21:58.693900 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-b42ad749-c630-4caf-8332-3c9c4b8a1be5 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] 10.222.0.16 "GET /compute/v2.1/servers/98a9a544-4553-4083-aa26-1dc327369d54" status: 200 len: 1553 microversion: 2.1 time: 0.475121 Oct 31 19:21:58.694599 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 81/163] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:21:58 2022] GET /compute/v2.1/servers/98a9a544-4553-4083-aa26-1dc327369d54 => generated 1553 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:21:58.955057 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-0f830b1d-293a-4d6f-8387-9a6ed9428c9a tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:21:58.956778 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-0f830b1d-293a-4d6f-8387-9a6ed9428c9a tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 37698c73-94da-4904-a8d5-636936092fba] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:21:58.964821 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-0f830b1d-293a-4d6f-8387-9a6ed9428c9a tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:58.965534 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-0f830b1d-293a-4d6f-8387-9a6ed9428c9a tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:58.966023 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-0f830b1d-293a-4d6f-8387-9a6ed9428c9a tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:58.966991 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-0f830b1d-293a-4d6f-8387-9a6ed9428c9a tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:58.967706 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-0f830b1d-293a-4d6f-8387-9a6ed9428c9a tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:58.968153 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-0f830b1d-293a-4d6f-8387-9a6ed9428c9a tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:59.129090 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-4c546a80-c92e-47b7-8cb3-a8e68aa7b4c8 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:21:59.129759 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-4c546a80-c92e-47b7-8cb3-a8e68aa7b4c8 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] [instance: 005f4b9f-db45-4bed-9eba-55b70d6b2229] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:21:59.139364 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-0f830b1d-293a-4d6f-8387-9a6ed9428c9a tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc49f9eb3114759b2889ed8972136d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cf63c76fc543428404002ae9a75b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:21:59.154904 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-0f830b1d-293a-4d6f-8387-9a6ed9428c9a tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/37698c73-94da-4904-a8d5-636936092fba" status: 200 len: 1520 microversion: 2.1 time: 0.204093 Oct 31 19:21:59.156963 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-4c546a80-c92e-47b7-8cb3-a8e68aa7b4c8 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:59.157662 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-4c546a80-c92e-47b7-8cb3-a8e68aa7b4c8 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:59.158242 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-4c546a80-c92e-47b7-8cb3-a8e68aa7b4c8 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:59.158944 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-4c546a80-c92e-47b7-8cb3-a8e68aa7b4c8 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:59.160005 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-4c546a80-c92e-47b7-8cb3-a8e68aa7b4c8 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:59.160555 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-4c546a80-c92e-47b7-8cb3-a8e68aa7b4c8 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:59.165702 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 83/164] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:21:58 2022] GET /compute/v2.1/servers/37698c73-94da-4904-a8d5-636936092fba => generated 1520 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:21:59.515864 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-4c546a80-c92e-47b7-8cb3-a8e68aa7b4c8 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f250770909504592978a8d8c9fb7d668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f19afdd98f2e4f49935bc8f8cf0211d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:21:59.524121 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-4c546a80-c92e-47b7-8cb3-a8e68aa7b4c8 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] 10.222.0.16 "GET /compute/v2.1/servers/005f4b9f-db45-4bed-9eba-55b70d6b2229" status: 200 len: 1315 microversion: 2.1 time: 0.399122 Oct 31 19:21:59.525475 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 82/165] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:21:59 2022] GET /compute/v2.1/servers/005f4b9f-db45-4bed-9eba-55b70d6b2229 => generated 1315 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 19:21:59.717516 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-d1b5b897-49a5-498c-8ef0-0451ca604860 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:21:59.718137 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-d1b5b897-49a5-498c-8ef0-0451ca604860 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] [instance: 98a9a544-4553-4083-aa26-1dc327369d54] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:21:59.724593 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-d1b5b897-49a5-498c-8ef0-0451ca604860 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:59.725076 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-d1b5b897-49a5-498c-8ef0-0451ca604860 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:59.725503 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-d1b5b897-49a5-498c-8ef0-0451ca604860 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:59.726214 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-d1b5b897-49a5-498c-8ef0-0451ca604860 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:21:59.726691 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-d1b5b897-49a5-498c-8ef0-0451ca604860 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:21:59.727096 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-d1b5b897-49a5-498c-8ef0-0451ca604860 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:21:59.787213 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-d1b5b897-49a5-498c-8ef0-0451ca604860 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af27927be0e249bfb320652152f501bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c549a25d33441e98aae78e940a69c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:21:59.795800 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-d1b5b897-49a5-498c-8ef0-0451ca604860 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] 10.222.0.16 "GET /compute/v2.1/servers/98a9a544-4553-4083-aa26-1dc327369d54" status: 200 len: 1345 microversion: 2.1 time: 0.082141 Oct 31 19:21:59.796573 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 84/166] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:21:59 2022] GET /compute/v2.1/servers/98a9a544-4553-4083-aa26-1dc327369d54 => generated 1345 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:22:00.183649 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-64116e88-d23c-46b8-8461-756b61cbb1ca tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:22:00.184378 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-64116e88-d23c-46b8-8461-756b61cbb1ca tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 37698c73-94da-4904-a8d5-636936092fba] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:22:00.198662 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-64116e88-d23c-46b8-8461-756b61cbb1ca tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:00.199162 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-64116e88-d23c-46b8-8461-756b61cbb1ca tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:00.199995 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-64116e88-d23c-46b8-8461-756b61cbb1ca tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:00.200746 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-64116e88-d23c-46b8-8461-756b61cbb1ca tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:00.201237 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-64116e88-d23c-46b8-8461-756b61cbb1ca tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:00.201704 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-64116e88-d23c-46b8-8461-756b61cbb1ca tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:00.366418 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-64116e88-d23c-46b8-8461-756b61cbb1ca tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc49f9eb3114759b2889ed8972136d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cf63c76fc543428404002ae9a75b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:22:00.376120 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-64116e88-d23c-46b8-8461-756b61cbb1ca tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/37698c73-94da-4904-a8d5-636936092fba" status: 200 len: 1520 microversion: 2.1 time: 0.200530 Oct 31 19:22:00.389786 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 83/167] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:22:00 2022] GET /compute/v2.1/servers/37698c73-94da-4904-a8d5-636936092fba => generated 1520 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:22:00.549049 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-5a7e6ea2-5f4b-4c6b-9766-202944aefabb tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:22:00.549775 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-5a7e6ea2-5f4b-4c6b-9766-202944aefabb tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] [instance: 005f4b9f-db45-4bed-9eba-55b70d6b2229] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:22:00.569838 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-5a7e6ea2-5f4b-4c6b-9766-202944aefabb tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:00.569838 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-5a7e6ea2-5f4b-4c6b-9766-202944aefabb tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:00.569838 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-5a7e6ea2-5f4b-4c6b-9766-202944aefabb tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:00.569838 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-5a7e6ea2-5f4b-4c6b-9766-202944aefabb tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:00.570295 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-5a7e6ea2-5f4b-4c6b-9766-202944aefabb tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:00.570295 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-5a7e6ea2-5f4b-4c6b-9766-202944aefabb tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:00.623827 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [req-b8531e3e-1d36-4d55-9bc9-a1e2f89eb7da req-404fcd01-c194-44a9-b222-0d8cad42b2ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98a9a544-4553-4083-aa26-1dc327369d54", "name": "network-vif-deleted", "tag": "c411fd72-ddd2-4429-98b0-69e862f32b98"}]} {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:22:00.633178 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [req-b8531e3e-1d36-4d55-9bc9-a1e2f89eb7da req-404fcd01-c194-44a9-b222-0d8cad42b2ce service nova] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:00.633676 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [req-b8531e3e-1d36-4d55-9bc9-a1e2f89eb7da req-404fcd01-c194-44a9-b222-0d8cad42b2ce service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:00.634674 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [req-b8531e3e-1d36-4d55-9bc9-a1e2f89eb7da req-404fcd01-c194-44a9-b222-0d8cad42b2ce service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:00.648051 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.compute.server_external_events [req-b8531e3e-1d36-4d55-9bc9-a1e2f89eb7da req-404fcd01-c194-44a9-b222-0d8cad42b2ce service nova] Creating event network-vif-deleted:c411fd72-ddd2-4429-98b0-69e862f32b98 for instance 98a9a544-4553-4083-aa26-1dc327369d54 on hv-cinder-86309 Oct 31 19:22:00.653253 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [req-b8531e3e-1d36-4d55-9bc9-a1e2f89eb7da req-404fcd01-c194-44a9-b222-0d8cad42b2ce service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033035 Oct 31 19:22:00.657645 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 84/168] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 31 19:22:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 19:22:00.708251 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-5a7e6ea2-5f4b-4c6b-9766-202944aefabb tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f250770909504592978a8d8c9fb7d668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f19afdd98f2e4f49935bc8f8cf0211d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:22:00.715801 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-5a7e6ea2-5f4b-4c6b-9766-202944aefabb tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] 10.222.0.16 "GET /compute/v2.1/servers/005f4b9f-db45-4bed-9eba-55b70d6b2229" status: 200 len: 1315 microversion: 2.1 time: 0.170706 Oct 31 19:22:00.716375 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 85/169] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:22:00 2022] GET /compute/v2.1/servers/005f4b9f-db45-4bed-9eba-55b70d6b2229 => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:22:00.820381 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-ca49ef9a-9097-4df3-91e3-a027d78bd5b6 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:22:00.821084 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-ca49ef9a-9097-4df3-91e3-a027d78bd5b6 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] [instance: 98a9a544-4553-4083-aa26-1dc327369d54] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:22:00.827111 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-ca49ef9a-9097-4df3-91e3-a027d78bd5b6 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:00.827590 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-ca49ef9a-9097-4df3-91e3-a027d78bd5b6 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:00.828023 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-ca49ef9a-9097-4df3-91e3-a027d78bd5b6 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:00.828716 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-ca49ef9a-9097-4df3-91e3-a027d78bd5b6 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:00.829167 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-ca49ef9a-9097-4df3-91e3-a027d78bd5b6 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:00.829592 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-ca49ef9a-9097-4df3-91e3-a027d78bd5b6 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:00.861362 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-ca49ef9a-9097-4df3-91e3-a027d78bd5b6 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:00.861970 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-ca49ef9a-9097-4df3-91e3-a027d78bd5b6 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:00.862972 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-ca49ef9a-9097-4df3-91e3-a027d78bd5b6 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:00.863590 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.objects.instance [None req-ca49ef9a-9097-4df3-91e3-a027d78bd5b6 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Lazy-loading 'fault' on Instance uuid 98a9a544-4553-4083-aa26-1dc327369d54 {{(pid=118727) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 19:22:00.914715 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-ca49ef9a-9097-4df3-91e3-a027d78bd5b6 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af27927be0e249bfb320652152f501bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c549a25d33441e98aae78e940a69c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:22:00.922262 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-ca49ef9a-9097-4df3-91e3-a027d78bd5b6 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] 10.222.0.16 "GET /compute/v2.1/servers/98a9a544-4553-4083-aa26-1dc327369d54" status: 200 len: 1304 microversion: 2.1 time: 0.106797 Oct 31 19:22:00.922828 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 85/170] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:22:00 2022] GET /compute/v2.1/servers/98a9a544-4553-4083-aa26-1dc327369d54 => generated 1304 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:22:01.400863 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-6dd32d79-c76f-445b-9828-94e3468eaa46 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:22:01.401378 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-6dd32d79-c76f-445b-9828-94e3468eaa46 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 37698c73-94da-4904-a8d5-636936092fba] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:22:01.403755 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG dbcounter [-] [118726] Writing DB stats nova_cell0:SELECT=2 {{(pid=118726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:22:01.409490 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-6dd32d79-c76f-445b-9828-94e3468eaa46 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:01.410026 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-6dd32d79-c76f-445b-9828-94e3468eaa46 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:01.410467 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-6dd32d79-c76f-445b-9828-94e3468eaa46 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:01.411167 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-6dd32d79-c76f-445b-9828-94e3468eaa46 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:01.412028 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-6dd32d79-c76f-445b-9828-94e3468eaa46 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:01.412480 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-6dd32d79-c76f-445b-9828-94e3468eaa46 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:01.546437 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-6dd32d79-c76f-445b-9828-94e3468eaa46 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc49f9eb3114759b2889ed8972136d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cf63c76fc543428404002ae9a75b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:22:01.556006 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-6dd32d79-c76f-445b-9828-94e3468eaa46 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/37698c73-94da-4904-a8d5-636936092fba" status: 200 len: 1520 microversion: 2.1 time: 0.158956 Oct 31 19:22:01.558475 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 86/171] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:22:01 2022] GET /compute/v2.1/servers/37698c73-94da-4904-a8d5-636936092fba => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:22:01.739448 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-ff621626-bb73-4cd9-8252-6730e845e093 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:22:01.740060 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-ff621626-bb73-4cd9-8252-6730e845e093 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] [instance: 005f4b9f-db45-4bed-9eba-55b70d6b2229] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:22:01.742174 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG dbcounter [-] [118727] Writing DB stats nova_cell0:SELECT=2 {{(pid=118727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:22:01.742839 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG dbcounter [-] [118727] Writing DB stats nova_cell0:SELECT=6 {{(pid=118727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:22:01.748933 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-ff621626-bb73-4cd9-8252-6730e845e093 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:01.749540 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-ff621626-bb73-4cd9-8252-6730e845e093 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:01.750005 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-ff621626-bb73-4cd9-8252-6730e845e093 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:01.750735 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-ff621626-bb73-4cd9-8252-6730e845e093 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:01.751191 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-ff621626-bb73-4cd9-8252-6730e845e093 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:01.751620 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-ff621626-bb73-4cd9-8252-6730e845e093 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:01.895082 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-ff621626-bb73-4cd9-8252-6730e845e093 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f250770909504592978a8d8c9fb7d668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f19afdd98f2e4f49935bc8f8cf0211d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:22:01.904663 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-ff621626-bb73-4cd9-8252-6730e845e093 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] 10.222.0.16 "GET /compute/v2.1/servers/005f4b9f-db45-4bed-9eba-55b70d6b2229" status: 200 len: 1315 microversion: 2.1 time: 0.169436 Oct 31 19:22:01.905637 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 86/172] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:22:01 2022] GET /compute/v2.1/servers/005f4b9f-db45-4bed-9eba-55b70d6b2229 => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:22:01.946971 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-78158c82-d2e1-4d31-9b7d-ad54bc976419 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:22:01.947581 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-78158c82-d2e1-4d31-9b7d-ad54bc976419 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] [instance: 98a9a544-4553-4083-aa26-1dc327369d54] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:22:01.954206 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-78158c82-d2e1-4d31-9b7d-ad54bc976419 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:01.954884 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-78158c82-d2e1-4d31-9b7d-ad54bc976419 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:01.955535 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-78158c82-d2e1-4d31-9b7d-ad54bc976419 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:01.956586 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-78158c82-d2e1-4d31-9b7d-ad54bc976419 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:01.957377 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-78158c82-d2e1-4d31-9b7d-ad54bc976419 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:01.963452 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-78158c82-d2e1-4d31-9b7d-ad54bc976419 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:01.980892 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.wsgi [None req-78158c82-d2e1-4d31-9b7d-ad54bc976419 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] HTTP exception thrown: Instance 98a9a544-4553-4083-aa26-1dc327369d54 could not be found. Oct 31 19:22:01.985674 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-78158c82-d2e1-4d31-9b7d-ad54bc976419 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Request method failure captured: Oct 31 19:22:01.985674 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: request: GET /compute/v2.1/servers/98a9a544-4553-4083-aa26-1dc327369d54 HTTP/1.1 Oct 31 19:22:01.985674 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: Accept: application/json Oct 31 19:22:01.985674 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: Accept-Encoding: identity Oct 31 19:22:01.985674 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: Connection: close Oct 31 19:22:01.985674 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: Content-Length: 0 Oct 31 19:22:01.985674 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: Content-Type: application/json Oct 31 19:22:01.985674 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: Host: 10.222.0.16 Oct 31 19:22:01.985674 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: Openstack-System-Scope: None Oct 31 19:22:01.985674 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: User-Agent: python-urllib3/1.26.12 Oct 31 19:22:01.985674 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Auth-Token: gAAAAABjYCAQki5K-uJlI2AT35kFz_1rY8Hy5LysYz4dKNmIg3M9FfrdkQz9uBzX95acTck3TxHosTwCzWuYNxURABLd1BSDPqJ72BLvJTzmN56JqGM8pE5HG5iZ_WNExC_dASHOXK6v_FtA098fwRWcefqo59I95FUykuHgE-tOFMsdgV5eP6I Oct 31 19:22:01.985674 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Domain-Id: None Oct 31 19:22:01.985674 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Domain-Name: None Oct 31 19:22:01.985674 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Identity-Status: Confirmed Oct 31 19:22:01.985674 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Is-Admin-Project: True Oct 31 19:22:01.985674 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Project-Domain-Id: default Oct 31 19:22:01.985674 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Project-Domain-Name: Default Oct 31 19:22:01.985674 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Project-Id: 4c549a25d33441e98aae78e940a69c7c Oct 31 19:22:01.985674 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Project-Name: tempest-DeleteServersTestJSON-1267500742 Oct 31 19:22:01.985674 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Role: member,reader Oct 31 19:22:01.985674 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Roles: member,reader Oct 31 19:22:01.987123 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4c549a25d33441e98aae78e940a69c7c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4c549a25d33441e98aae78e940a69c7c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4c549a25d33441e98aae78e940a69c7c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4c549a25d33441e98aae78e940a69c7c"}]}] Oct 31 19:22:01.987123 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Tenant: tempest-DeleteServersTestJSON-1267500742 Oct 31 19:22:01.987123 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Tenant-Id: 4c549a25d33441e98aae78e940a69c7c Oct 31 19:22:01.987123 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Tenant-Name: tempest-DeleteServersTestJSON-1267500742 Oct 31 19:22:01.987123 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-User: tempest-DeleteServersTestJSON-1267500742-project Oct 31 19:22:01.987123 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-User-Domain-Id: default Oct 31 19:22:01.987123 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-User-Domain-Name: Default Oct 31 19:22:01.987123 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-User-Id: af27927be0e249bfb320652152f501bc Oct 31 19:22:01.987123 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-User-Name: tempest-DeleteServersTestJSON-1267500742-project Oct 31 19:22:01.987123 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: method: > Oct 31 19:22:01.987123 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: exception: Instance 98a9a544-4553-4083-aa26-1dc327369d54 could not be found. Oct 31 19:22:01.987123 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: action_args: {'id': '98a9a544-4553-4083-aa26-1dc327369d54'} Oct 31 19:22:01.988683 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 19:22:01.988683 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:22:01.988683 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 19:22:01.988683 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 19:22:01.988683 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 19:22:01.988683 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 19:22:01.988683 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 19:22:01.988683 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 19:22:01.988683 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 19:22:01.988683 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 19:22:01.988683 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98a9a544-4553-4083-aa26-1dc327369d54 could not be found. Oct 31 19:22:01.988683 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Oct 31 19:22:01.988683 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 19:22:01.988683 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Oct 31 19:22:01.988683 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:22:01.988683 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 19:22:01.988683 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 19:22:01.988683 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 19:22:01.988683 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 19:22:01.988683 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 19:22:01.990134 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 19:22:01.990134 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 19:22:01.990134 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 19:22:01.990134 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 19:22:01.990134 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 19:22:01.990134 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 19:22:01.990134 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 19:22:01.990134 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98a9a544-4553-4083-aa26-1dc327369d54 could not be found. Oct 31 19:22:01.990134 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Oct 31 19:22:01.990134 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 19:22:01.990134 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Oct 31 19:22:01.990134 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:22:01.990134 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 19:22:01.990134 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 19:22:01.990134 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 19:22:01.990134 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 19:22:01.990134 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98a9a544-4553-4083-aa26-1dc327369d54 could not be found. Oct 31 19:22:01.990134 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Oct 31 19:22:01.994512 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-78158c82-d2e1-4d31-9b7d-ad54bc976419 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Returning 404 to user: Instance 98a9a544-4553-4083-aa26-1dc327369d54 could not be found. {{(pid=118726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 19:22:01.995377 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-78158c82-d2e1-4d31-9b7d-ad54bc976419 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] 10.222.0.16 "GET /compute/v2.1/servers/98a9a544-4553-4083-aa26-1dc327369d54" status: 404 len: 111 microversion: 2.1 time: 0.054476 Oct 31 19:22:01.996409 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 87/173] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:22:01 2022] GET /compute/v2.1/servers/98a9a544-4553-4083-aa26-1dc327369d54 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 19:22:02.113989 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-406d484f-c128-4257-81a1-bfdee60089be tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:22:02.116149 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-406d484f-c128-4257-81a1-bfdee60089be tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] [instance: 98a9a544-4553-4083-aa26-1dc327369d54] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:22:02.121950 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-406d484f-c128-4257-81a1-bfdee60089be tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:02.122431 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-406d484f-c128-4257-81a1-bfdee60089be tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:02.122864 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-406d484f-c128-4257-81a1-bfdee60089be tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:02.123556 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-406d484f-c128-4257-81a1-bfdee60089be tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:02.124006 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-406d484f-c128-4257-81a1-bfdee60089be tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:02.124428 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-406d484f-c128-4257-81a1-bfdee60089be tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:02.136691 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.wsgi [None req-406d484f-c128-4257-81a1-bfdee60089be tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] HTTP exception thrown: Instance 98a9a544-4553-4083-aa26-1dc327369d54 could not be found. Oct 31 19:22:02.140948 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-406d484f-c128-4257-81a1-bfdee60089be tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Request method failure captured: Oct 31 19:22:02.140948 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: request: GET /compute/v2.1/servers/98a9a544-4553-4083-aa26-1dc327369d54/os-volume_attachments HTTP/1.1 Oct 31 19:22:02.140948 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Accept: application/json Oct 31 19:22:02.140948 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Accept-Encoding: identity Oct 31 19:22:02.140948 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Connection: close Oct 31 19:22:02.140948 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Content-Length: 0 Oct 31 19:22:02.140948 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Content-Type: application/json Oct 31 19:22:02.140948 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Host: 10.222.0.16 Oct 31 19:22:02.140948 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Openstack-System-Scope: None Oct 31 19:22:02.140948 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: User-Agent: python-urllib3/1.26.12 Oct 31 19:22:02.140948 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Auth-Token: gAAAAABjYCAQki5K-uJlI2AT35kFz_1rY8Hy5LysYz4dKNmIg3M9FfrdkQz9uBzX95acTck3TxHosTwCzWuYNxURABLd1BSDPqJ72BLvJTzmN56JqGM8pE5HG5iZ_WNExC_dASHOXK6v_FtA098fwRWcefqo59I95FUykuHgE-tOFMsdgV5eP6I Oct 31 19:22:02.140948 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Domain-Id: None Oct 31 19:22:02.140948 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Domain-Name: None Oct 31 19:22:02.140948 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Identity-Status: Confirmed Oct 31 19:22:02.140948 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Is-Admin-Project: True Oct 31 19:22:02.140948 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Project-Domain-Id: default Oct 31 19:22:02.140948 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Project-Domain-Name: Default Oct 31 19:22:02.140948 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Project-Id: 4c549a25d33441e98aae78e940a69c7c Oct 31 19:22:02.140948 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Project-Name: tempest-DeleteServersTestJSON-1267500742 Oct 31 19:22:02.140948 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Role: member,reader Oct 31 19:22:02.140948 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Roles: member,reader Oct 31 19:22:02.142323 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4c549a25d33441e98aae78e940a69c7c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4c549a25d33441e98aae78e940a69c7c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4c549a25d33441e98aae78e940a69c7c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4c549a25d33441e98aae78e940a69c7c"}]}] Oct 31 19:22:02.142323 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Tenant: tempest-DeleteServersTestJSON-1267500742 Oct 31 19:22:02.142323 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Tenant-Id: 4c549a25d33441e98aae78e940a69c7c Oct 31 19:22:02.142323 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Tenant-Name: tempest-DeleteServersTestJSON-1267500742 Oct 31 19:22:02.142323 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User: tempest-DeleteServersTestJSON-1267500742-project Oct 31 19:22:02.142323 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User-Domain-Id: default Oct 31 19:22:02.142323 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User-Domain-Name: Default Oct 31 19:22:02.142323 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User-Id: af27927be0e249bfb320652152f501bc Oct 31 19:22:02.142323 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User-Name: tempest-DeleteServersTestJSON-1267500742-project Oct 31 19:22:02.142323 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: method: > Oct 31 19:22:02.142323 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: exception: Instance 98a9a544-4553-4083-aa26-1dc327369d54 could not be found. Oct 31 19:22:02.142323 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: action_args: {'server_id': '98a9a544-4553-4083-aa26-1dc327369d54'} Oct 31 19:22:02.146098 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 19:22:02.146098 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:22:02.146098 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 19:22:02.146098 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 19:22:02.146098 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 19:22:02.146098 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 19:22:02.146098 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 19:22:02.146098 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 19:22:02.146098 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 19:22:02.146098 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 19:22:02.146098 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98a9a544-4553-4083-aa26-1dc327369d54 could not be found. Oct 31 19:22:02.146098 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:22:02.146098 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 19:22:02.146098 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:22:02.146098 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:22:02.146098 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 19:22:02.146098 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 19:22:02.146098 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 19:22:02.146098 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 19:22:02.146098 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 19:22:02.147394 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 19:22:02.147394 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 31 19:22:02.147394 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 19:22:02.147394 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 31 19:22:02.147394 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 19:22:02.147394 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 31 19:22:02.147394 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 31 19:22:02.147394 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 19:22:02.147394 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 19:22:02.147394 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98a9a544-4553-4083-aa26-1dc327369d54 could not be found. Oct 31 19:22:02.147394 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:22:02.147394 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 19:22:02.147394 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:22:02.147394 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:22:02.147394 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 19:22:02.147394 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 19:22:02.147394 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 19:22:02.147394 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 19:22:02.147394 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98a9a544-4553-4083-aa26-1dc327369d54 could not be found. Oct 31 19:22:02.147394 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:22:02.148531 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-406d484f-c128-4257-81a1-bfdee60089be tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Returning 404 to user: Instance 98a9a544-4553-4083-aa26-1dc327369d54 could not be found. {{(pid=118727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 19:22:02.148531 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-406d484f-c128-4257-81a1-bfdee60089be tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] 10.222.0.16 "GET /compute/v2.1/servers/98a9a544-4553-4083-aa26-1dc327369d54/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.033231 Oct 31 19:22:02.148531 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 87/174] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Oct 31 19:22:02 2022] GET /compute/v2.1/servers/98a9a544-4553-4083-aa26-1dc327369d54/os-volume_attachments => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 19:22:02.580680 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-a94c8472-232f-4ac6-863d-30e8b45405fc tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:22:02.581522 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-a94c8472-232f-4ac6-863d-30e8b45405fc tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 37698c73-94da-4904-a8d5-636936092fba] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:22:02.587829 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-a94c8472-232f-4ac6-863d-30e8b45405fc tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:02.588301 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-a94c8472-232f-4ac6-863d-30e8b45405fc tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:02.588725 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-a94c8472-232f-4ac6-863d-30e8b45405fc tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:02.589412 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-a94c8472-232f-4ac6-863d-30e8b45405fc tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:02.589913 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-a94c8472-232f-4ac6-863d-30e8b45405fc tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:02.590331 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-a94c8472-232f-4ac6-863d-30e8b45405fc tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:02.731048 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-a94c8472-232f-4ac6-863d-30e8b45405fc tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc49f9eb3114759b2889ed8972136d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cf63c76fc543428404002ae9a75b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:22:02.738889 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-a94c8472-232f-4ac6-863d-30e8b45405fc tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/37698c73-94da-4904-a8d5-636936092fba" status: 200 len: 1520 microversion: 2.1 time: 0.162181 Oct 31 19:22:02.739454 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 88/175] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:22:02 2022] GET /compute/v2.1/servers/37698c73-94da-4904-a8d5-636936092fba => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 19:22:02.928546 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-51a7ba01-497c-4e90-9fbd-bd5a4230577b tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:22:02.929103 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-51a7ba01-497c-4e90-9fbd-bd5a4230577b tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] [instance: 005f4b9f-db45-4bed-9eba-55b70d6b2229] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:22:02.935091 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-51a7ba01-497c-4e90-9fbd-bd5a4230577b tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:02.935565 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-51a7ba01-497c-4e90-9fbd-bd5a4230577b tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:02.935989 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-51a7ba01-497c-4e90-9fbd-bd5a4230577b tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:02.936660 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-51a7ba01-497c-4e90-9fbd-bd5a4230577b tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:02.937120 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-51a7ba01-497c-4e90-9fbd-bd5a4230577b tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:02.937520 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-51a7ba01-497c-4e90-9fbd-bd5a4230577b tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:03.085813 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-51a7ba01-497c-4e90-9fbd-bd5a4230577b tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f250770909504592978a8d8c9fb7d668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f19afdd98f2e4f49935bc8f8cf0211d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:22:03.087233 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-51a7ba01-497c-4e90-9fbd-bd5a4230577b tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] 10.222.0.16 "GET /compute/v2.1/servers/005f4b9f-db45-4bed-9eba-55b70d6b2229" status: 200 len: 1315 microversion: 2.1 time: 0.162654 Oct 31 19:22:03.087998 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 88/176] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:22:02 2022] GET /compute/v2.1/servers/005f4b9f-db45-4bed-9eba-55b70d6b2229 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:22:03.350223 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-cc609ec4-fc54-464b-aa0b-c252e9250e3e tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:22:03.350883 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-cc609ec4-fc54-464b-aa0b-c252e9250e3e tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] [instance: 98a9a544-4553-4083-aa26-1dc327369d54] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:22:03.357196 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-cc609ec4-fc54-464b-aa0b-c252e9250e3e tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:03.357895 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-cc609ec4-fc54-464b-aa0b-c252e9250e3e tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:03.358415 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-cc609ec4-fc54-464b-aa0b-c252e9250e3e tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:03.359269 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-cc609ec4-fc54-464b-aa0b-c252e9250e3e tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:03.359721 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-cc609ec4-fc54-464b-aa0b-c252e9250e3e tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:03.360306 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-cc609ec4-fc54-464b-aa0b-c252e9250e3e tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:03.513416 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.wsgi [None req-cc609ec4-fc54-464b-aa0b-c252e9250e3e tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] HTTP exception thrown: Instance 98a9a544-4553-4083-aa26-1dc327369d54 could not be found. Oct 31 19:22:03.515079 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-cc609ec4-fc54-464b-aa0b-c252e9250e3e tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Request method failure captured: Oct 31 19:22:03.515079 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: request: DELETE /compute/v2.1/servers/98a9a544-4553-4083-aa26-1dc327369d54 HTTP/1.1 Oct 31 19:22:03.515079 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: Accept: application/json Oct 31 19:22:03.515079 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: Accept-Encoding: identity Oct 31 19:22:03.515079 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: Connection: close Oct 31 19:22:03.515079 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: Content-Length: 0 Oct 31 19:22:03.515079 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: Content-Type: application/json Oct 31 19:22:03.515079 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: Host: 10.222.0.16 Oct 31 19:22:03.515079 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: Openstack-System-Scope: None Oct 31 19:22:03.515079 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: User-Agent: python-urllib3/1.26.12 Oct 31 19:22:03.515079 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Auth-Token: gAAAAABjYCAQki5K-uJlI2AT35kFz_1rY8Hy5LysYz4dKNmIg3M9FfrdkQz9uBzX95acTck3TxHosTwCzWuYNxURABLd1BSDPqJ72BLvJTzmN56JqGM8pE5HG5iZ_WNExC_dASHOXK6v_FtA098fwRWcefqo59I95FUykuHgE-tOFMsdgV5eP6I Oct 31 19:22:03.515079 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Domain-Id: None Oct 31 19:22:03.515079 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Domain-Name: None Oct 31 19:22:03.515079 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Identity-Status: Confirmed Oct 31 19:22:03.515079 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Is-Admin-Project: True Oct 31 19:22:03.515079 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Project-Domain-Id: default Oct 31 19:22:03.515079 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Project-Domain-Name: Default Oct 31 19:22:03.515079 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Project-Id: 4c549a25d33441e98aae78e940a69c7c Oct 31 19:22:03.515079 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Project-Name: tempest-DeleteServersTestJSON-1267500742 Oct 31 19:22:03.515079 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Role: member,reader Oct 31 19:22:03.515079 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Roles: member,reader Oct 31 19:22:03.516433 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4c549a25d33441e98aae78e940a69c7c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4c549a25d33441e98aae78e940a69c7c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4c549a25d33441e98aae78e940a69c7c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4c549a25d33441e98aae78e940a69c7c"}]}] Oct 31 19:22:03.516433 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Tenant: tempest-DeleteServersTestJSON-1267500742 Oct 31 19:22:03.516433 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Tenant-Id: 4c549a25d33441e98aae78e940a69c7c Oct 31 19:22:03.516433 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Tenant-Name: tempest-DeleteServersTestJSON-1267500742 Oct 31 19:22:03.516433 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-User: tempest-DeleteServersTestJSON-1267500742-project Oct 31 19:22:03.516433 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-User-Domain-Id: default Oct 31 19:22:03.516433 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-User-Domain-Name: Default Oct 31 19:22:03.516433 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-User-Id: af27927be0e249bfb320652152f501bc Oct 31 19:22:03.516433 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-User-Name: tempest-DeleteServersTestJSON-1267500742-project Oct 31 19:22:03.516433 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: method: > Oct 31 19:22:03.516433 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: exception: Instance 98a9a544-4553-4083-aa26-1dc327369d54 could not be found. Oct 31 19:22:03.516433 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: action_args: {'id': '98a9a544-4553-4083-aa26-1dc327369d54'} Oct 31 19:22:03.517069 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 19:22:03.517069 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:22:03.517069 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 19:22:03.517069 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 19:22:03.517069 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 19:22:03.517069 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 19:22:03.517069 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 19:22:03.517069 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 19:22:03.517069 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 19:22:03.517069 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 19:22:03.517069 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98a9a544-4553-4083-aa26-1dc327369d54 could not be found. Oct 31 19:22:03.517069 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Oct 31 19:22:03.517069 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 19:22:03.517069 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Oct 31 19:22:03.517069 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:22:03.517069 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 19:22:03.517069 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 19:22:03.517069 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 19:22:03.517069 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 19:22:03.517069 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 19:22:03.518435 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 19:22:03.518435 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 19:22:03.518435 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 19:22:03.518435 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 19:22:03.518435 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 19:22:03.518435 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 19:22:03.518435 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 19:22:03.518435 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 19:22:03.518435 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 19:22:03.518435 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98a9a544-4553-4083-aa26-1dc327369d54 could not be found. Oct 31 19:22:03.518435 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Oct 31 19:22:03.518435 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 19:22:03.518435 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Oct 31 19:22:03.518435 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:22:03.518435 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 19:22:03.518435 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 19:22:03.518435 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 19:22:03.518435 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 19:22:03.518435 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98a9a544-4553-4083-aa26-1dc327369d54 could not be found. Oct 31 19:22:03.518435 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Oct 31 19:22:03.519597 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-cc609ec4-fc54-464b-aa0b-c252e9250e3e tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Returning 404 to user: Instance 98a9a544-4553-4083-aa26-1dc327369d54 could not be found. {{(pid=118726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 19:22:03.519597 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-cc609ec4-fc54-464b-aa0b-c252e9250e3e tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] 10.222.0.16 "DELETE /compute/v2.1/servers/98a9a544-4553-4083-aa26-1dc327369d54" status: 404 len: 111 microversion: 2.1 time: 0.171206 Oct 31 19:22:03.519597 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 89/177] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 31 19:22:03 2022] DELETE /compute/v2.1/servers/98a9a544-4553-4083-aa26-1dc327369d54 => generated 111 bytes in 172 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 19:22:03.525079 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-bbb0fe30-8be1-4129-a186-ec87676d3b11 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:22:03.525720 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-bbb0fe30-8be1-4129-a186-ec87676d3b11 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] [instance: 98a9a544-4553-4083-aa26-1dc327369d54] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:22:03.531540 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-bbb0fe30-8be1-4129-a186-ec87676d3b11 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:03.532011 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-bbb0fe30-8be1-4129-a186-ec87676d3b11 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:03.532454 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-bbb0fe30-8be1-4129-a186-ec87676d3b11 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:03.533150 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-bbb0fe30-8be1-4129-a186-ec87676d3b11 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:03.533644 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-bbb0fe30-8be1-4129-a186-ec87676d3b11 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:03.534066 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-bbb0fe30-8be1-4129-a186-ec87676d3b11 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:03.550870 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.wsgi [None req-bbb0fe30-8be1-4129-a186-ec87676d3b11 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] HTTP exception thrown: Instance 98a9a544-4553-4083-aa26-1dc327369d54 could not be found. Oct 31 19:22:03.553168 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-bbb0fe30-8be1-4129-a186-ec87676d3b11 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Request method failure captured: Oct 31 19:22:03.553168 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: request: GET /compute/v2.1/servers/98a9a544-4553-4083-aa26-1dc327369d54 HTTP/1.1 Oct 31 19:22:03.553168 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Accept: application/json Oct 31 19:22:03.553168 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Accept-Encoding: identity Oct 31 19:22:03.553168 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Connection: close Oct 31 19:22:03.553168 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Content-Length: 0 Oct 31 19:22:03.553168 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Content-Type: application/json Oct 31 19:22:03.553168 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Host: 10.222.0.16 Oct 31 19:22:03.553168 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Openstack-System-Scope: None Oct 31 19:22:03.553168 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: User-Agent: python-urllib3/1.26.12 Oct 31 19:22:03.553168 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Auth-Token: gAAAAABjYCAQki5K-uJlI2AT35kFz_1rY8Hy5LysYz4dKNmIg3M9FfrdkQz9uBzX95acTck3TxHosTwCzWuYNxURABLd1BSDPqJ72BLvJTzmN56JqGM8pE5HG5iZ_WNExC_dASHOXK6v_FtA098fwRWcefqo59I95FUykuHgE-tOFMsdgV5eP6I Oct 31 19:22:03.553168 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Domain-Id: None Oct 31 19:22:03.553168 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Domain-Name: None Oct 31 19:22:03.553168 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Identity-Status: Confirmed Oct 31 19:22:03.553168 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Is-Admin-Project: True Oct 31 19:22:03.553168 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Project-Domain-Id: default Oct 31 19:22:03.553168 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Project-Domain-Name: Default Oct 31 19:22:03.553168 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Project-Id: 4c549a25d33441e98aae78e940a69c7c Oct 31 19:22:03.553168 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Project-Name: tempest-DeleteServersTestJSON-1267500742 Oct 31 19:22:03.553168 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Role: member,reader Oct 31 19:22:03.553168 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Roles: member,reader Oct 31 19:22:03.554752 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4c549a25d33441e98aae78e940a69c7c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4c549a25d33441e98aae78e940a69c7c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4c549a25d33441e98aae78e940a69c7c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4c549a25d33441e98aae78e940a69c7c"}]}] Oct 31 19:22:03.554752 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Tenant: tempest-DeleteServersTestJSON-1267500742 Oct 31 19:22:03.554752 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Tenant-Id: 4c549a25d33441e98aae78e940a69c7c Oct 31 19:22:03.554752 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Tenant-Name: tempest-DeleteServersTestJSON-1267500742 Oct 31 19:22:03.554752 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User: tempest-DeleteServersTestJSON-1267500742-project Oct 31 19:22:03.554752 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User-Domain-Id: default Oct 31 19:22:03.554752 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User-Domain-Name: Default Oct 31 19:22:03.554752 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User-Id: af27927be0e249bfb320652152f501bc Oct 31 19:22:03.554752 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User-Name: tempest-DeleteServersTestJSON-1267500742-project Oct 31 19:22:03.554752 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: method: > Oct 31 19:22:03.554752 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: exception: Instance 98a9a544-4553-4083-aa26-1dc327369d54 could not be found. Oct 31 19:22:03.554752 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: action_args: {'id': '98a9a544-4553-4083-aa26-1dc327369d54'} Oct 31 19:22:03.555500 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 19:22:03.555500 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:22:03.555500 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 19:22:03.555500 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 19:22:03.555500 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 19:22:03.555500 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 19:22:03.555500 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 19:22:03.555500 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 19:22:03.555500 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 19:22:03.555500 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 19:22:03.555500 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98a9a544-4553-4083-aa26-1dc327369d54 could not be found. Oct 31 19:22:03.555500 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:22:03.555500 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 19:22:03.555500 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:22:03.555500 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:22:03.555500 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 19:22:03.555500 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 19:22:03.555500 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 19:22:03.555500 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 19:22:03.555500 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 19:22:03.556568 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 19:22:03.556568 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 19:22:03.556568 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 19:22:03.556568 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 19:22:03.556568 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 19:22:03.556568 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 19:22:03.556568 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 19:22:03.556568 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98a9a544-4553-4083-aa26-1dc327369d54 could not be found. Oct 31 19:22:03.556568 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:22:03.556568 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 19:22:03.556568 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:22:03.556568 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:22:03.556568 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 19:22:03.556568 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 19:22:03.556568 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 19:22:03.556568 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 19:22:03.556568 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98a9a544-4553-4083-aa26-1dc327369d54 could not be found. Oct 31 19:22:03.556568 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:22:03.557497 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-bbb0fe30-8be1-4129-a186-ec87676d3b11 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] Returning 404 to user: Instance 98a9a544-4553-4083-aa26-1dc327369d54 could not be found. {{(pid=118727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 19:22:03.557497 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-bbb0fe30-8be1-4129-a186-ec87676d3b11 tempest-DeleteServersTestJSON-1267500742 tempest-DeleteServersTestJSON-1267500742-project] 10.222.0.16 "GET /compute/v2.1/servers/98a9a544-4553-4083-aa26-1dc327369d54" status: 404 len: 111 microversion: 2.1 time: 0.033463 Oct 31 19:22:03.557497 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 89/178] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:22:03 2022] GET /compute/v2.1/servers/98a9a544-4553-4083-aa26-1dc327369d54 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 19:22:03.762701 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-9cf0547e-1a3a-4813-9812-3b7abebaa79f tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:22:03.763308 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-9cf0547e-1a3a-4813-9812-3b7abebaa79f tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 37698c73-94da-4904-a8d5-636936092fba] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:22:03.770001 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-9cf0547e-1a3a-4813-9812-3b7abebaa79f tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:03.770481 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-9cf0547e-1a3a-4813-9812-3b7abebaa79f tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:03.770946 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-9cf0547e-1a3a-4813-9812-3b7abebaa79f tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:03.771638 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-9cf0547e-1a3a-4813-9812-3b7abebaa79f tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:03.772094 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-9cf0547e-1a3a-4813-9812-3b7abebaa79f tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:03.772516 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-9cf0547e-1a3a-4813-9812-3b7abebaa79f tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:03.911643 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-9cf0547e-1a3a-4813-9812-3b7abebaa79f tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc49f9eb3114759b2889ed8972136d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cf63c76fc543428404002ae9a75b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:22:03.919614 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-9cf0547e-1a3a-4813-9812-3b7abebaa79f tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/37698c73-94da-4904-a8d5-636936092fba" status: 200 len: 1520 microversion: 2.1 time: 0.161009 Oct 31 19:22:03.924819 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 90/179] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:22:03 2022] GET /compute/v2.1/servers/37698c73-94da-4904-a8d5-636936092fba => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:22:04.113405 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-931cb419-4283-4f5a-a701-f2c3d437dc41 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:22:04.114136 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-931cb419-4283-4f5a-a701-f2c3d437dc41 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] [instance: 005f4b9f-db45-4bed-9eba-55b70d6b2229] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:22:04.117839 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG dbcounter [-] [118727] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=3 {{(pid=118727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:22:04.128549 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-931cb419-4283-4f5a-a701-f2c3d437dc41 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:04.129267 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-931cb419-4283-4f5a-a701-f2c3d437dc41 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:04.129958 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-931cb419-4283-4f5a-a701-f2c3d437dc41 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:04.130757 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-931cb419-4283-4f5a-a701-f2c3d437dc41 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:04.131279 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-931cb419-4283-4f5a-a701-f2c3d437dc41 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:04.131772 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-931cb419-4283-4f5a-a701-f2c3d437dc41 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:04.330072 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-931cb419-4283-4f5a-a701-f2c3d437dc41 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f250770909504592978a8d8c9fb7d668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f19afdd98f2e4f49935bc8f8cf0211d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:22:04.338342 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-931cb419-4283-4f5a-a701-f2c3d437dc41 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] 10.222.0.16 "GET /compute/v2.1/servers/005f4b9f-db45-4bed-9eba-55b70d6b2229" status: 200 len: 1315 microversion: 2.1 time: 0.228834 Oct 31 19:22:04.339131 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 90/180] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:22:04 2022] GET /compute/v2.1/servers/005f4b9f-db45-4bed-9eba-55b70d6b2229 => generated 1315 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:22:04.947139 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-ad9bab71-1969-48cc-9a94-9eecaa8dd226 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:22:04.947767 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-ad9bab71-1969-48cc-9a94-9eecaa8dd226 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 37698c73-94da-4904-a8d5-636936092fba] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:22:04.953872 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-ad9bab71-1969-48cc-9a94-9eecaa8dd226 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:04.954354 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-ad9bab71-1969-48cc-9a94-9eecaa8dd226 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:04.954786 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-ad9bab71-1969-48cc-9a94-9eecaa8dd226 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:04.955475 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-ad9bab71-1969-48cc-9a94-9eecaa8dd226 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:04.955926 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-ad9bab71-1969-48cc-9a94-9eecaa8dd226 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:04.956544 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-ad9bab71-1969-48cc-9a94-9eecaa8dd226 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:05.114736 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-ad9bab71-1969-48cc-9a94-9eecaa8dd226 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc49f9eb3114759b2889ed8972136d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cf63c76fc543428404002ae9a75b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:22:05.125298 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-ad9bab71-1969-48cc-9a94-9eecaa8dd226 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/37698c73-94da-4904-a8d5-636936092fba" status: 200 len: 1520 microversion: 2.1 time: 0.181394 Oct 31 19:22:05.142184 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 91/181] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:22:04 2022] GET /compute/v2.1/servers/37698c73-94da-4904-a8d5-636936092fba => generated 1520 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:22:05.361311 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-acee369e-5766-409e-aecd-18450974539e tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:22:05.361932 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-acee369e-5766-409e-aecd-18450974539e tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] [instance: 005f4b9f-db45-4bed-9eba-55b70d6b2229] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:22:05.372054 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-acee369e-5766-409e-aecd-18450974539e tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:05.373134 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-acee369e-5766-409e-aecd-18450974539e tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:05.373585 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-acee369e-5766-409e-aecd-18450974539e tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:05.375259 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-acee369e-5766-409e-aecd-18450974539e tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:05.376037 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-acee369e-5766-409e-aecd-18450974539e tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:05.376371 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-acee369e-5766-409e-aecd-18450974539e tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:05.638077 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-acee369e-5766-409e-aecd-18450974539e tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f250770909504592978a8d8c9fb7d668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f19afdd98f2e4f49935bc8f8cf0211d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:22:05.646909 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-acee369e-5766-409e-aecd-18450974539e tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] 10.222.0.16 "GET /compute/v2.1/servers/005f4b9f-db45-4bed-9eba-55b70d6b2229" status: 200 len: 1315 microversion: 2.1 time: 0.290336 Oct 31 19:22:05.648012 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 91/182] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:22:05 2022] GET /compute/v2.1/servers/005f4b9f-db45-4bed-9eba-55b70d6b2229 => generated 1315 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:22:06.150526 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-5e20129b-3d66-4f7b-a48b-0a250e4c6590 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:22:06.151218 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-5e20129b-3d66-4f7b-a48b-0a250e4c6590 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 37698c73-94da-4904-a8d5-636936092fba] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:22:06.158316 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-5e20129b-3d66-4f7b-a48b-0a250e4c6590 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:06.159012 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-5e20129b-3d66-4f7b-a48b-0a250e4c6590 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:06.160218 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-5e20129b-3d66-4f7b-a48b-0a250e4c6590 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:06.161077 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-5e20129b-3d66-4f7b-a48b-0a250e4c6590 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:06.161729 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-5e20129b-3d66-4f7b-a48b-0a250e4c6590 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:06.162309 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-5e20129b-3d66-4f7b-a48b-0a250e4c6590 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:06.320738 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-5e20129b-3d66-4f7b-a48b-0a250e4c6590 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc49f9eb3114759b2889ed8972136d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cf63c76fc543428404002ae9a75b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:22:06.330868 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-5e20129b-3d66-4f7b-a48b-0a250e4c6590 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/37698c73-94da-4904-a8d5-636936092fba" status: 200 len: 1520 microversion: 2.1 time: 0.184382 Oct 31 19:22:06.332120 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 92/183] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:22:06 2022] GET /compute/v2.1/servers/37698c73-94da-4904-a8d5-636936092fba => generated 1520 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 19:22:06.674941 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-e2af1b64-cde0-44e3-a7e7-9d5254236555 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:22:06.674941 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-e2af1b64-cde0-44e3-a7e7-9d5254236555 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] [instance: 005f4b9f-db45-4bed-9eba-55b70d6b2229] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:22:06.682314 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-e2af1b64-cde0-44e3-a7e7-9d5254236555 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:06.682598 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-e2af1b64-cde0-44e3-a7e7-9d5254236555 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:06.683807 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-e2af1b64-cde0-44e3-a7e7-9d5254236555 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:06.684804 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-e2af1b64-cde0-44e3-a7e7-9d5254236555 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:06.685842 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-e2af1b64-cde0-44e3-a7e7-9d5254236555 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:06.686508 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-e2af1b64-cde0-44e3-a7e7-9d5254236555 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:06.859780 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-e2af1b64-cde0-44e3-a7e7-9d5254236555 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f250770909504592978a8d8c9fb7d668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f19afdd98f2e4f49935bc8f8cf0211d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:22:06.871157 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-e2af1b64-cde0-44e3-a7e7-9d5254236555 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] 10.222.0.16 "GET /compute/v2.1/servers/005f4b9f-db45-4bed-9eba-55b70d6b2229" status: 200 len: 1315 microversion: 2.1 time: 0.200610 Oct 31 19:22:06.871701 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 92/184] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:22:06 2022] GET /compute/v2.1/servers/005f4b9f-db45-4bed-9eba-55b70d6b2229 => generated 1315 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:22:07.359523 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-68b46a5e-ea94-4121-a14b-79f34cc30c23 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:22:07.360231 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-68b46a5e-ea94-4121-a14b-79f34cc30c23 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 37698c73-94da-4904-a8d5-636936092fba] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:22:07.366628 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-68b46a5e-ea94-4121-a14b-79f34cc30c23 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:07.367190 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-68b46a5e-ea94-4121-a14b-79f34cc30c23 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:07.367710 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-68b46a5e-ea94-4121-a14b-79f34cc30c23 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:07.368506 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-68b46a5e-ea94-4121-a14b-79f34cc30c23 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:07.369031 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-68b46a5e-ea94-4121-a14b-79f34cc30c23 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:07.369521 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-68b46a5e-ea94-4121-a14b-79f34cc30c23 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:07.506779 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-68b46a5e-ea94-4121-a14b-79f34cc30c23 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc49f9eb3114759b2889ed8972136d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cf63c76fc543428404002ae9a75b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:22:07.513376 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-68b46a5e-ea94-4121-a14b-79f34cc30c23 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/37698c73-94da-4904-a8d5-636936092fba" status: 200 len: 1520 microversion: 2.1 time: 0.157694 Oct 31 19:22:07.514089 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 93/185] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:22:07 2022] GET /compute/v2.1/servers/37698c73-94da-4904-a8d5-636936092fba => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:22:07.894229 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-ae1fd51e-7740-4775-a5b9-d47d4f51855f tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:22:07.894908 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-ae1fd51e-7740-4775-a5b9-d47d4f51855f tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] [instance: 005f4b9f-db45-4bed-9eba-55b70d6b2229] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:22:07.900793 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-ae1fd51e-7740-4775-a5b9-d47d4f51855f tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:07.901506 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-ae1fd51e-7740-4775-a5b9-d47d4f51855f tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:07.902156 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-ae1fd51e-7740-4775-a5b9-d47d4f51855f tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:07.902867 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-ae1fd51e-7740-4775-a5b9-d47d4f51855f tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:07.903322 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-ae1fd51e-7740-4775-a5b9-d47d4f51855f tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:07.903742 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-ae1fd51e-7740-4775-a5b9-d47d4f51855f tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:08.045287 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-ae1fd51e-7740-4775-a5b9-d47d4f51855f tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f250770909504592978a8d8c9fb7d668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f19afdd98f2e4f49935bc8f8cf0211d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:22:08.053286 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-ae1fd51e-7740-4775-a5b9-d47d4f51855f tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] 10.222.0.16 "GET /compute/v2.1/servers/005f4b9f-db45-4bed-9eba-55b70d6b2229" status: 200 len: 1315 microversion: 2.1 time: 0.162991 Oct 31 19:22:08.065875 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 93/186] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:22:07 2022] GET /compute/v2.1/servers/005f4b9f-db45-4bed-9eba-55b70d6b2229 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:22:08.536310 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-666443df-ecd0-451d-9dfc-7a24964646f7 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:22:08.537163 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-666443df-ecd0-451d-9dfc-7a24964646f7 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 37698c73-94da-4904-a8d5-636936092fba] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:22:08.544567 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-666443df-ecd0-451d-9dfc-7a24964646f7 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:08.545281 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-666443df-ecd0-451d-9dfc-7a24964646f7 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:08.545735 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-666443df-ecd0-451d-9dfc-7a24964646f7 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:08.547169 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-666443df-ecd0-451d-9dfc-7a24964646f7 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:08.547717 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-666443df-ecd0-451d-9dfc-7a24964646f7 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:08.548283 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-666443df-ecd0-451d-9dfc-7a24964646f7 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:08.555307 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-47462ad2-7393-49a5-9499-b3c3fe52f984 tempest-VolumesSnapshotsTestJSON-213380412 tempest-VolumesSnapshotsTestJSON-213380412-project] Action: 'create', calling method: .version_select at 0x7f34f2264f70>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1151996591"}} {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:22:08.748979 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-666443df-ecd0-451d-9dfc-7a24964646f7 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc49f9eb3114759b2889ed8972136d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cf63c76fc543428404002ae9a75b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:22:08.756680 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-666443df-ecd0-451d-9dfc-7a24964646f7 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/37698c73-94da-4904-a8d5-636936092fba" status: 200 len: 1520 microversion: 2.1 time: 0.224226 Oct 31 19:22:08.757537 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 94/187] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:22:08 2022] GET /compute/v2.1/servers/37698c73-94da-4904-a8d5-636936092fba => generated 1520 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 19:22:08.952851 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-47462ad2-7393-49a5-9499-b3c3fe52f984 tempest-VolumesSnapshotsTestJSON-213380412 tempest-VolumesSnapshotsTestJSON-213380412-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.554561 Oct 31 19:22:08.957145 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 94/188] 10.222.0.16 () {60 vars in 1155 bytes} [Mon Oct 31 19:22:08 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 560 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 31 19:22:08.970504 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-76e19bf2-0c06-4c41-9b00-5a45bc4b2526 tempest-VolumesSnapshotsTestJSON-213380412 tempest-VolumesSnapshotsTestJSON-213380412-project] Calling method '.version_select at 0x7f34f2338310>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:22:09.046910 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-76e19bf2-0c06-4c41-9b00-5a45bc4b2526 tempest-VolumesSnapshotsTestJSON-213380412 tempest-VolumesSnapshotsTestJSON-213380412-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/3c40adb3-a60e-4531-932a-0968111836c4" status: 200 len: 345 microversion: 2.1 time: 0.080575 Oct 31 19:22:09.047480 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 95/189] 10.222.0.16 () {58 vars in 1245 bytes} [Mon Oct 31 19:22:08 2022] GET /compute/v2.1/os-volumes/3c40adb3-a60e-4531-932a-0968111836c4 => generated 345 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:22:09.078738 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-0a5d5ed1-f907-4d2d-9e95-6053b71c7683 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:22:09.079698 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-0a5d5ed1-f907-4d2d-9e95-6053b71c7683 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] [instance: 005f4b9f-db45-4bed-9eba-55b70d6b2229] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:22:09.088154 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-0a5d5ed1-f907-4d2d-9e95-6053b71c7683 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:09.088642 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-0a5d5ed1-f907-4d2d-9e95-6053b71c7683 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:09.089341 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-0a5d5ed1-f907-4d2d-9e95-6053b71c7683 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:09.090167 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-0a5d5ed1-f907-4d2d-9e95-6053b71c7683 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:09.090703 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-0a5d5ed1-f907-4d2d-9e95-6053b71c7683 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:09.091196 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-0a5d5ed1-f907-4d2d-9e95-6053b71c7683 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:09.241834 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-0a5d5ed1-f907-4d2d-9e95-6053b71c7683 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f250770909504592978a8d8c9fb7d668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f19afdd98f2e4f49935bc8f8cf0211d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:22:09.249583 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-0a5d5ed1-f907-4d2d-9e95-6053b71c7683 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] 10.222.0.16 "GET /compute/v2.1/servers/005f4b9f-db45-4bed-9eba-55b70d6b2229" status: 200 len: 1315 microversion: 2.1 time: 0.175948 Oct 31 19:22:09.250163 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 95/190] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:22:09 2022] GET /compute/v2.1/servers/005f4b9f-db45-4bed-9eba-55b70d6b2229 => generated 1315 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:22:09.782587 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-368a09be-425c-40a3-ab28-542dc0bb0f4f tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:22:09.783197 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-368a09be-425c-40a3-ab28-542dc0bb0f4f tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 37698c73-94da-4904-a8d5-636936092fba] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:22:09.790655 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-368a09be-425c-40a3-ab28-542dc0bb0f4f tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:09.791243 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-368a09be-425c-40a3-ab28-542dc0bb0f4f tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:09.792166 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-368a09be-425c-40a3-ab28-542dc0bb0f4f tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:09.793033 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-368a09be-425c-40a3-ab28-542dc0bb0f4f tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:09.793515 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-368a09be-425c-40a3-ab28-542dc0bb0f4f tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:09.793951 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-368a09be-425c-40a3-ab28-542dc0bb0f4f tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:09.941404 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-368a09be-425c-40a3-ab28-542dc0bb0f4f tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc49f9eb3114759b2889ed8972136d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cf63c76fc543428404002ae9a75b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:22:09.950307 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-368a09be-425c-40a3-ab28-542dc0bb0f4f tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/37698c73-94da-4904-a8d5-636936092fba" status: 200 len: 1520 microversion: 2.1 time: 0.174124 Oct 31 19:22:09.950875 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 96/191] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:22:09 2022] GET /compute/v2.1/servers/37698c73-94da-4904-a8d5-636936092fba => generated 1520 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:22:10.061417 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-ffdd53be-96bb-4e89-bdaa-bd8bb8a9f963 tempest-VolumesSnapshotsTestJSON-213380412 tempest-VolumesSnapshotsTestJSON-213380412-project] Calling method '.version_select at 0x7f34f23d19d0>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:22:10.111738 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-ffdd53be-96bb-4e89-bdaa-bd8bb8a9f963 tempest-VolumesSnapshotsTestJSON-213380412 tempest-VolumesSnapshotsTestJSON-213380412-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/3c40adb3-a60e-4531-932a-0968111836c4" status: 200 len: 346 microversion: 2.1 time: 0.053998 Oct 31 19:22:10.112883 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 96/192] 10.222.0.16 () {58 vars in 1245 bytes} [Mon Oct 31 19:22:10 2022] GET /compute/v2.1/os-volumes/3c40adb3-a60e-4531-932a-0968111836c4 => generated 346 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:22:10.125833 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-951aec90-47f3-474f-a5d9-4ba611cb6d35 tempest-VolumesSnapshotsTestJSON-213380412 tempest-VolumesSnapshotsTestJSON-213380412-project] Action: 'create', calling method: .version_select at 0x7f34f210ab80>, body: {"snapshot": {"volume_id": "3c40adb3-a60e-4531-932a-0968111836c4", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-421923152"}} {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:22:10.274829 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-056e5323-5f58-4337-8a47-0885a5071b4b tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:22:10.275812 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-056e5323-5f58-4337-8a47-0885a5071b4b tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] [instance: 005f4b9f-db45-4bed-9eba-55b70d6b2229] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:22:10.282092 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-056e5323-5f58-4337-8a47-0885a5071b4b tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:10.282642 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-056e5323-5f58-4337-8a47-0885a5071b4b tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:10.283293 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-056e5323-5f58-4337-8a47-0885a5071b4b tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:10.284086 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-056e5323-5f58-4337-8a47-0885a5071b4b tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:10.284607 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-056e5323-5f58-4337-8a47-0885a5071b4b tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:10.285094 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-056e5323-5f58-4337-8a47-0885a5071b4b tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:10.317860 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-951aec90-47f3-474f-a5d9-4ba611cb6d35 tempest-VolumesSnapshotsTestJSON-213380412 tempest-VolumesSnapshotsTestJSON-213380412-project] 10.222.0.16 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.195800 Oct 31 19:22:10.318852 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 97/193] 10.222.0.16 () {60 vars in 1162 bytes} [Mon Oct 31 19:22:10 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:22:10.332314 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-fced2a9d-4cba-4dcf-9ee6-321b16f4586a tempest-VolumesSnapshotsTestJSON-213380412 tempest-VolumesSnapshotsTestJSON-213380412-project] Calling method '.version_select at 0x7f34f21344c0>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:22:10.363831 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-fced2a9d-4cba-4dcf-9ee6-321b16f4586a tempest-VolumesSnapshotsTestJSON-213380412 tempest-VolumesSnapshotsTestJSON-213380412-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/824667b0-a097-4973-ae28-66f433797460" status: 200 len: 286 microversion: 2.1 time: 0.037224 Oct 31 19:22:10.364804 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 98/194] 10.222.0.16 () {58 vars in 1251 bytes} [Mon Oct 31 19:22:10 2022] GET /compute/v2.1/os-snapshots/824667b0-a097-4973-ae28-66f433797460 => generated 286 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 19:22:10.375354 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-6ebc1a64-46c1-46db-9505-e48e33bb95ff tempest-VolumesSnapshotsTestJSON-213380412 tempest-VolumesSnapshotsTestJSON-213380412-project] Calling method '.version_select at 0x7f34f2134dc0>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:22:10.414393 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-6ebc1a64-46c1-46db-9505-e48e33bb95ff tempest-VolumesSnapshotsTestJSON-213380412 tempest-VolumesSnapshotsTestJSON-213380412-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.042563 Oct 31 19:22:10.415145 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 99/195] 10.222.0.16 () {58 vars in 1140 bytes} [Mon Oct 31 19:22:10 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 19:22:10.429563 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-3f23254f-4fd1-42d4-b2aa-c2b1ba0f22a5 tempest-VolumesSnapshotsTestJSON-213380412 tempest-VolumesSnapshotsTestJSON-213380412-project] Calling method '.version_select at 0x7f34f2316940>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:22:10.468388 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-3f23254f-4fd1-42d4-b2aa-c2b1ba0f22a5 tempest-VolumesSnapshotsTestJSON-213380412 tempest-VolumesSnapshotsTestJSON-213380412-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/824667b0-a097-4973-ae28-66f433797460" status: 200 len: 286 microversion: 2.1 time: 0.041607 Oct 31 19:22:10.472122 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 100/196] 10.222.0.16 () {58 vars in 1251 bytes} [Mon Oct 31 19:22:10 2022] GET /compute/v2.1/os-snapshots/824667b0-a097-4973-ae28-66f433797460 => generated 286 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:22:10.485175 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-056e5323-5f58-4337-8a47-0885a5071b4b tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f250770909504592978a8d8c9fb7d668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f19afdd98f2e4f49935bc8f8cf0211d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:22:10.493220 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-056e5323-5f58-4337-8a47-0885a5071b4b tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] 10.222.0.16 "GET /compute/v2.1/servers/005f4b9f-db45-4bed-9eba-55b70d6b2229" status: 200 len: 1315 microversion: 2.1 time: 0.223139 Oct 31 19:22:10.493813 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 97/197] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:22:10 2022] GET /compute/v2.1/servers/005f4b9f-db45-4bed-9eba-55b70d6b2229 => generated 1315 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 19:22:10.597749 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [req-3aef0a44-3145-453a-a393-168b39385beb req-e8d6e790-5656-4591-b90d-3e13428c66b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "005f4b9f-db45-4bed-9eba-55b70d6b2229", "name": "network-vif-plugged", "status": "completed", "tag": "58080e2a-842b-4b20-bd5a-8cca7dca5e72"}]} {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:22:10.608980 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [req-3aef0a44-3145-453a-a393-168b39385beb req-e8d6e790-5656-4591-b90d-3e13428c66b2 service nova] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:10.609716 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [req-3aef0a44-3145-453a-a393-168b39385beb req-e8d6e790-5656-4591-b90d-3e13428c66b2 service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:10.610403 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [req-3aef0a44-3145-453a-a393-168b39385beb req-e8d6e790-5656-4591-b90d-3e13428c66b2 service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:10.623880 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.compute.server_external_events [req-3aef0a44-3145-453a-a393-168b39385beb req-e8d6e790-5656-4591-b90d-3e13428c66b2 service nova] Creating event network-vif-plugged:58080e2a-842b-4b20-bd5a-8cca7dca5e72 for instance 005f4b9f-db45-4bed-9eba-55b70d6b2229 on hv-cinder-86309 Oct 31 19:22:10.629596 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [req-3aef0a44-3145-453a-a393-168b39385beb req-e8d6e790-5656-4591-b90d-3e13428c66b2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037400 Oct 31 19:22:10.630444 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 101/198] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 31 19:22:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:22:10.976273 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-6dad3f7e-1372-48dc-a612-8e9acebabc34 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:22:10.976885 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-6dad3f7e-1372-48dc-a612-8e9acebabc34 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 37698c73-94da-4904-a8d5-636936092fba] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:22:10.982835 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-6dad3f7e-1372-48dc-a612-8e9acebabc34 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:10.983312 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-6dad3f7e-1372-48dc-a612-8e9acebabc34 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:10.983748 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-6dad3f7e-1372-48dc-a612-8e9acebabc34 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:10.984435 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-6dad3f7e-1372-48dc-a612-8e9acebabc34 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:10.984891 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-6dad3f7e-1372-48dc-a612-8e9acebabc34 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:10.985314 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-6dad3f7e-1372-48dc-a612-8e9acebabc34 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:11.116618 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-6dad3f7e-1372-48dc-a612-8e9acebabc34 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc49f9eb3114759b2889ed8972136d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cf63c76fc543428404002ae9a75b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:22:11.120020 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG dbcounter [-] [118726] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:22:11.126514 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-6dad3f7e-1372-48dc-a612-8e9acebabc34 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/37698c73-94da-4904-a8d5-636936092fba" status: 200 len: 1520 microversion: 2.1 time: 0.154900 Oct 31 19:22:11.127091 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 98/199] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:22:10 2022] GET /compute/v2.1/servers/37698c73-94da-4904-a8d5-636936092fba => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:22:11.480296 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-4357f1ad-f4f1-4e4e-b3fb-1ddd88394921 tempest-VolumesSnapshotsTestJSON-213380412 tempest-VolumesSnapshotsTestJSON-213380412-project] Calling method '.version_select at 0x7f34f2134310>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:22:11.516369 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-8d114e48-7afb-4661-b2af-3bc3e0f41380 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:22:11.516986 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-8d114e48-7afb-4661-b2af-3bc3e0f41380 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] [instance: 005f4b9f-db45-4bed-9eba-55b70d6b2229] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:22:11.517538 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-4357f1ad-f4f1-4e4e-b3fb-1ddd88394921 tempest-VolumesSnapshotsTestJSON-213380412 tempest-VolumesSnapshotsTestJSON-213380412-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/824667b0-a097-4973-ae28-66f433797460" status: 200 len: 286 microversion: 2.1 time: 0.041635 Oct 31 19:22:11.518278 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 102/200] 10.222.0.16 () {58 vars in 1251 bytes} [Mon Oct 31 19:22:11 2022] GET /compute/v2.1/os-snapshots/824667b0-a097-4973-ae28-66f433797460 => generated 286 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:22:11.523440 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-8d114e48-7afb-4661-b2af-3bc3e0f41380 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:11.523916 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-8d114e48-7afb-4661-b2af-3bc3e0f41380 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:11.524344 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-8d114e48-7afb-4661-b2af-3bc3e0f41380 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:11.525033 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-8d114e48-7afb-4661-b2af-3bc3e0f41380 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:11.525485 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-8d114e48-7afb-4661-b2af-3bc3e0f41380 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:11.525933 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-8d114e48-7afb-4661-b2af-3bc3e0f41380 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:11.671089 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-8d114e48-7afb-4661-b2af-3bc3e0f41380 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f250770909504592978a8d8c9fb7d668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f19afdd98f2e4f49935bc8f8cf0211d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:22:11.679387 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-8d114e48-7afb-4661-b2af-3bc3e0f41380 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] 10.222.0.16 "GET /compute/v2.1/servers/005f4b9f-db45-4bed-9eba-55b70d6b2229" status: 200 len: 1315 microversion: 2.1 time: 0.167286 Oct 31 19:22:11.680106 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 99/201] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:22:11 2022] GET /compute/v2.1/servers/005f4b9f-db45-4bed-9eba-55b70d6b2229 => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:22:12.150773 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-326384d3-c46b-41dd-9119-7a8da393820b tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:22:12.151599 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-326384d3-c46b-41dd-9119-7a8da393820b tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 37698c73-94da-4904-a8d5-636936092fba] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:22:12.157914 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-326384d3-c46b-41dd-9119-7a8da393820b tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:12.158464 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-326384d3-c46b-41dd-9119-7a8da393820b tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:12.159123 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-326384d3-c46b-41dd-9119-7a8da393820b tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:12.160336 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-326384d3-c46b-41dd-9119-7a8da393820b tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:12.160854 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-326384d3-c46b-41dd-9119-7a8da393820b tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:12.161226 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-326384d3-c46b-41dd-9119-7a8da393820b tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:12.295909 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-326384d3-c46b-41dd-9119-7a8da393820b tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc49f9eb3114759b2889ed8972136d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cf63c76fc543428404002ae9a75b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:22:12.303833 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-326384d3-c46b-41dd-9119-7a8da393820b tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/37698c73-94da-4904-a8d5-636936092fba" status: 200 len: 1520 microversion: 2.1 time: 0.157214 Oct 31 19:22:12.305676 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 103/202] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:22:12 2022] GET /compute/v2.1/servers/37698c73-94da-4904-a8d5-636936092fba => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:22:12.529838 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-d21a6540-044f-4555-8006-77fe0b3e4622 tempest-VolumesSnapshotsTestJSON-213380412 tempest-VolumesSnapshotsTestJSON-213380412-project] Calling method '.version_select at 0x7f34f20c8dc0>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:22:12.560037 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-d21a6540-044f-4555-8006-77fe0b3e4622 tempest-VolumesSnapshotsTestJSON-213380412 tempest-VolumesSnapshotsTestJSON-213380412-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/824667b0-a097-4973-ae28-66f433797460" status: 200 len: 286 microversion: 2.1 time: 0.034043 Oct 31 19:22:12.560607 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 100/203] 10.222.0.16 () {58 vars in 1251 bytes} [Mon Oct 31 19:22:12 2022] GET /compute/v2.1/os-snapshots/824667b0-a097-4973-ae28-66f433797460 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:22:12.701994 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-553293a9-d993-4b25-99e6-e608a68400ad tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:22:12.702707 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-553293a9-d993-4b25-99e6-e608a68400ad tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] [instance: 005f4b9f-db45-4bed-9eba-55b70d6b2229] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:22:12.709182 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-553293a9-d993-4b25-99e6-e608a68400ad tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:12.709822 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-553293a9-d993-4b25-99e6-e608a68400ad tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:12.710319 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-553293a9-d993-4b25-99e6-e608a68400ad tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:12.711095 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-553293a9-d993-4b25-99e6-e608a68400ad tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:12.711703 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-553293a9-d993-4b25-99e6-e608a68400ad tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:12.712182 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-553293a9-d993-4b25-99e6-e608a68400ad tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:12.858381 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-553293a9-d993-4b25-99e6-e608a68400ad tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f250770909504592978a8d8c9fb7d668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f19afdd98f2e4f49935bc8f8cf0211d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:22:12.866665 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-553293a9-d993-4b25-99e6-e608a68400ad tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] 10.222.0.16 "GET /compute/v2.1/servers/005f4b9f-db45-4bed-9eba-55b70d6b2229" status: 200 len: 1315 microversion: 2.1 time: 0.168337 Oct 31 19:22:12.867252 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 104/204] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:22:12 2022] GET /compute/v2.1/servers/005f4b9f-db45-4bed-9eba-55b70d6b2229 => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:22:13.327687 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-891a5221-918e-4aa1-8e5d-79a98ab5a4cb tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:22:13.328292 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-891a5221-918e-4aa1-8e5d-79a98ab5a4cb tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 37698c73-94da-4904-a8d5-636936092fba] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:22:13.334460 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-891a5221-918e-4aa1-8e5d-79a98ab5a4cb tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:13.335147 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-891a5221-918e-4aa1-8e5d-79a98ab5a4cb tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:13.335723 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-891a5221-918e-4aa1-8e5d-79a98ab5a4cb tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:13.336713 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-891a5221-918e-4aa1-8e5d-79a98ab5a4cb tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:13.337489 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-891a5221-918e-4aa1-8e5d-79a98ab5a4cb tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:13.338085 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-891a5221-918e-4aa1-8e5d-79a98ab5a4cb tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:13.486318 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-891a5221-918e-4aa1-8e5d-79a98ab5a4cb tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc49f9eb3114759b2889ed8972136d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cf63c76fc543428404002ae9a75b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:22:13.494075 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-891a5221-918e-4aa1-8e5d-79a98ab5a4cb tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/37698c73-94da-4904-a8d5-636936092fba" status: 200 len: 1520 microversion: 2.1 time: 0.170315 Oct 31 19:22:13.494661 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 101/205] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:22:13 2022] GET /compute/v2.1/servers/37698c73-94da-4904-a8d5-636936092fba => generated 1520 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:22:13.572238 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-8b208778-d79a-4272-abc8-a92993b8c7cf tempest-VolumesSnapshotsTestJSON-213380412 tempest-VolumesSnapshotsTestJSON-213380412-project] Calling method '.version_select at 0x7f34f2338e50>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:22:13.601595 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-8b208778-d79a-4272-abc8-a92993b8c7cf tempest-VolumesSnapshotsTestJSON-213380412 tempest-VolumesSnapshotsTestJSON-213380412-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/824667b0-a097-4973-ae28-66f433797460" status: 200 len: 286 microversion: 2.1 time: 0.033263 Oct 31 19:22:13.602172 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 105/206] 10.222.0.16 () {58 vars in 1251 bytes} [Mon Oct 31 19:22:13 2022] GET /compute/v2.1/os-snapshots/824667b0-a097-4973-ae28-66f433797460 => generated 286 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:22:13.889477 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-50be4151-7f8d-4d5e-a1fb-7e7b5acb4d79 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:22:13.890141 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-50be4151-7f8d-4d5e-a1fb-7e7b5acb4d79 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] [instance: 005f4b9f-db45-4bed-9eba-55b70d6b2229] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:22:13.897061 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-50be4151-7f8d-4d5e-a1fb-7e7b5acb4d79 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:13.897539 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-50be4151-7f8d-4d5e-a1fb-7e7b5acb4d79 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:13.897995 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-50be4151-7f8d-4d5e-a1fb-7e7b5acb4d79 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:13.898681 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-50be4151-7f8d-4d5e-a1fb-7e7b5acb4d79 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:13.899134 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-50be4151-7f8d-4d5e-a1fb-7e7b5acb4d79 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:13.899557 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-50be4151-7f8d-4d5e-a1fb-7e7b5acb4d79 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:14.025837 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-50be4151-7f8d-4d5e-a1fb-7e7b5acb4d79 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f250770909504592978a8d8c9fb7d668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f19afdd98f2e4f49935bc8f8cf0211d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:22:14.033707 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-50be4151-7f8d-4d5e-a1fb-7e7b5acb4d79 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] 10.222.0.16 "GET /compute/v2.1/servers/005f4b9f-db45-4bed-9eba-55b70d6b2229" status: 200 len: 1315 microversion: 2.1 time: 0.148056 Oct 31 19:22:14.034791 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 102/207] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:22:13 2022] GET /compute/v2.1/servers/005f4b9f-db45-4bed-9eba-55b70d6b2229 => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:22:14.518964 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-29758df0-c319-448f-be1b-734efa626fd5 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:22:14.519566 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-29758df0-c319-448f-be1b-734efa626fd5 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 37698c73-94da-4904-a8d5-636936092fba] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:22:14.526587 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-29758df0-c319-448f-be1b-734efa626fd5 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:14.527071 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-29758df0-c319-448f-be1b-734efa626fd5 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:14.527685 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-29758df0-c319-448f-be1b-734efa626fd5 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:14.528674 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-29758df0-c319-448f-be1b-734efa626fd5 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:14.529404 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-29758df0-c319-448f-be1b-734efa626fd5 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:14.530001 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-29758df0-c319-448f-be1b-734efa626fd5 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:14.616108 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-00528f38-d673-4caf-8d9c-d681d3bb7373 tempest-VolumesSnapshotsTestJSON-213380412 tempest-VolumesSnapshotsTestJSON-213380412-project] Calling method '.version_select at 0x7f34f2251af0>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:22:14.657372 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-00528f38-d673-4caf-8d9c-d681d3bb7373 tempest-VolumesSnapshotsTestJSON-213380412 tempest-VolumesSnapshotsTestJSON-213380412-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/824667b0-a097-4973-ae28-66f433797460" status: 200 len: 287 microversion: 2.1 time: 0.046476 Oct 31 19:22:14.666350 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 103/208] 10.222.0.16 () {58 vars in 1251 bytes} [Mon Oct 31 19:22:14 2022] GET /compute/v2.1/os-snapshots/824667b0-a097-4973-ae28-66f433797460 => generated 287 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:22:14.674194 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-1837c01b-4377-4def-8091-6516d86b5ea3 tempest-VolumesSnapshotsTestJSON-213380412 tempest-VolumesSnapshotsTestJSON-213380412-project] Calling method '.version_select at 0x7f34f2209d30>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:22:14.754636 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-1837c01b-4377-4def-8091-6516d86b5ea3 tempest-VolumesSnapshotsTestJSON-213380412 tempest-VolumesSnapshotsTestJSON-213380412-project] 10.222.0.16 "DELETE /compute/v2.1/os-snapshots/824667b0-a097-4973-ae28-66f433797460" status: 202 len: 0 microversion: 2.1 time: 0.085371 Oct 31 19:22:14.759110 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 104/209] 10.222.0.16 () {58 vars in 1254 bytes} [Mon Oct 31 19:22:14 2022] DELETE /compute/v2.1/os-snapshots/824667b0-a097-4973-ae28-66f433797460 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 19:22:14.765979 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-75f7f8ac-a5da-4a5c-8aa7-6b9db5ea9f91 tempest-VolumesSnapshotsTestJSON-213380412 tempest-VolumesSnapshotsTestJSON-213380412-project] Calling method '.version_select at 0x7f34f2209430>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:22:14.832378 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-75f7f8ac-a5da-4a5c-8aa7-6b9db5ea9f91 tempest-VolumesSnapshotsTestJSON-213380412 tempest-VolumesSnapshotsTestJSON-213380412-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/824667b0-a097-4973-ae28-66f433797460" status: 200 len: 286 microversion: 2.1 time: 0.072401 Oct 31 19:22:14.832947 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 105/210] 10.222.0.16 () {58 vars in 1251 bytes} [Mon Oct 31 19:22:14 2022] GET /compute/v2.1/os-snapshots/824667b0-a097-4973-ae28-66f433797460 => generated 286 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:22:14.835360 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-29758df0-c319-448f-be1b-734efa626fd5 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc49f9eb3114759b2889ed8972136d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cf63c76fc543428404002ae9a75b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:22:14.843260 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-29758df0-c319-448f-be1b-734efa626fd5 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/37698c73-94da-4904-a8d5-636936092fba" status: 200 len: 1520 microversion: 2.1 time: 0.328115 Oct 31 19:22:14.843940 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 106/211] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:22:14 2022] GET /compute/v2.1/servers/37698c73-94da-4904-a8d5-636936092fba => generated 1520 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:22:15.058838 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-1f122711-8fae-468c-b73a-46756b73cc0f tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:22:15.059482 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-1f122711-8fae-468c-b73a-46756b73cc0f tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] [instance: 005f4b9f-db45-4bed-9eba-55b70d6b2229] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:22:15.067396 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-1f122711-8fae-468c-b73a-46756b73cc0f tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:15.067879 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-1f122711-8fae-468c-b73a-46756b73cc0f tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:15.068311 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-1f122711-8fae-468c-b73a-46756b73cc0f tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:15.068990 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-1f122711-8fae-468c-b73a-46756b73cc0f tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:15.069437 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-1f122711-8fae-468c-b73a-46756b73cc0f tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:15.069883 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-1f122711-8fae-468c-b73a-46756b73cc0f tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:15.201773 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-1f122711-8fae-468c-b73a-46756b73cc0f tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f250770909504592978a8d8c9fb7d668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f19afdd98f2e4f49935bc8f8cf0211d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:22:15.210443 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-1f122711-8fae-468c-b73a-46756b73cc0f tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] 10.222.0.16 "GET /compute/v2.1/servers/005f4b9f-db45-4bed-9eba-55b70d6b2229" status: 200 len: 1315 microversion: 2.1 time: 0.156089 Oct 31 19:22:15.211014 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 106/212] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:22:15 2022] GET /compute/v2.1/servers/005f4b9f-db45-4bed-9eba-55b70d6b2229 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:22:15.847770 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-91e9b4b0-0154-4fc6-88ef-1bb031650829 tempest-VolumesSnapshotsTestJSON-213380412 tempest-VolumesSnapshotsTestJSON-213380412-project] Calling method '.version_select at 0x7f34f210ab80>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:22:15.874067 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-c820af47-9c97-46ce-95f6-ebec0e35f4b7 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:22:15.874067 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-c820af47-9c97-46ce-95f6-ebec0e35f4b7 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 37698c73-94da-4904-a8d5-636936092fba] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:22:15.874067 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-c820af47-9c97-46ce-95f6-ebec0e35f4b7 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:15.874067 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-c820af47-9c97-46ce-95f6-ebec0e35f4b7 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:15.874742 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-c820af47-9c97-46ce-95f6-ebec0e35f4b7 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:15.875530 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-c820af47-9c97-46ce-95f6-ebec0e35f4b7 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:15.876072 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-c820af47-9c97-46ce-95f6-ebec0e35f4b7 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:15.876599 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-c820af47-9c97-46ce-95f6-ebec0e35f4b7 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:15.900632 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.wsgi [None req-91e9b4b0-0154-4fc6-88ef-1bb031650829 tempest-VolumesSnapshotsTestJSON-213380412 tempest-VolumesSnapshotsTestJSON-213380412-project] HTTP exception thrown: Snapshot 824667b0-a097-4973-ae28-66f433797460 could not be found. Oct 31 19:22:15.902960 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-91e9b4b0-0154-4fc6-88ef-1bb031650829 tempest-VolumesSnapshotsTestJSON-213380412 tempest-VolumesSnapshotsTestJSON-213380412-project] Request method failure captured: Oct 31 19:22:15.902960 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: request: GET /compute/v2.1/os-snapshots/824667b0-a097-4973-ae28-66f433797460 HTTP/1.1 Oct 31 19:22:15.902960 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Accept: application/json Oct 31 19:22:15.902960 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Accept-Encoding: identity Oct 31 19:22:15.902960 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Connection: close Oct 31 19:22:15.902960 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Content-Length: 0 Oct 31 19:22:15.902960 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Content-Type: application/json Oct 31 19:22:15.902960 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Host: 10.222.0.16 Oct 31 19:22:15.902960 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Openstack-System-Scope: None Oct 31 19:22:15.902960 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: User-Agent: python-urllib3/1.26.12 Oct 31 19:22:15.902960 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Auth-Token: gAAAAABjYCBgh2irmEYIHp5VI0bLonHS2GCisFlMrwjWQDd9XlFH7u-rWAH6T5rDBDGCqK23SZY2kthyCWxx3B5w3K5807Xtg3qoUEBjC96gZs1X87W5WJot2sWIm3sp9-z0Q_ExhCfTjXNIKfishUdmw55O30LVBmobaPGlQVygs3CGC-WsA_4 Oct 31 19:22:15.902960 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Domain-Id: None Oct 31 19:22:15.902960 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Domain-Name: None Oct 31 19:22:15.902960 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Identity-Status: Confirmed Oct 31 19:22:15.902960 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Is-Admin-Project: True Oct 31 19:22:15.902960 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Project-Domain-Id: default Oct 31 19:22:15.902960 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Project-Domain-Name: Default Oct 31 19:22:15.902960 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Project-Id: 7afa2454354541a4955b74a82beb7af5 Oct 31 19:22:15.902960 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-213380412 Oct 31 19:22:15.902960 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Role: member,reader Oct 31 19:22:15.902960 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Roles: member,reader Oct 31 19:22:15.904409 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7afa2454354541a4955b74a82beb7af5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7afa2454354541a4955b74a82beb7af5", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7afa2454354541a4955b74a82beb7af5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7afa2454354541a4955b74a82beb7af5"}]}] Oct 31 19:22:15.904409 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Tenant: tempest-VolumesSnapshotsTestJSON-213380412 Oct 31 19:22:15.904409 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Tenant-Id: 7afa2454354541a4955b74a82beb7af5 Oct 31 19:22:15.904409 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-213380412 Oct 31 19:22:15.904409 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User: tempest-VolumesSnapshotsTestJSON-213380412-project Oct 31 19:22:15.904409 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User-Domain-Id: default Oct 31 19:22:15.904409 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User-Domain-Name: Default Oct 31 19:22:15.904409 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User-Id: 7fbe415527cc4b1ba3255e20105b6b97 Oct 31 19:22:15.904409 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User-Name: tempest-VolumesSnapshotsTestJSON-213380412-project Oct 31 19:22:15.904409 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: method: Oct 31 19:22:15.904409 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: exception: Snapshot 824667b0-a097-4973-ae28-66f433797460 could not be found. Oct 31 19:22:15.904409 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: action_args: {'id': '824667b0-a097-4973-ae28-66f433797460'} Oct 31 19:22:15.904409 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 19:22:15.905282 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:22:15.905282 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 31 19:22:15.905282 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 31 19:22:15.905282 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 31 19:22:15.905282 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 31 19:22:15.905282 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 31 19:22:15.905282 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 31 19:22:15.905282 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 31 19:22:15.905282 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 31 19:22:15.905282 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 31 19:22:15.905282 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 31 19:22:15.905282 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 31 19:22:15.905282 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 31 19:22:15.905282 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 31 19:22:15.905282 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 31 19:22:15.905282 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 824667b0-a097-4973-ae28-66f433797460 could not be found. (HTTP 404) (Request-ID: req-be40c3e2-0969-4c88-a3f7-eba5e1bcd17b) Oct 31 19:22:15.905282 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:22:15.905282 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 19:22:15.906576 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:22:15.906576 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:22:15.906576 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Oct 31 19:22:15.906576 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Oct 31 19:22:15.906576 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 31 19:22:15.906576 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 31 19:22:15.906576 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Oct 31 19:22:15.906576 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Oct 31 19:22:15.906576 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 31 19:22:15.906576 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 31 19:22:15.906576 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 31 19:22:15.906576 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 31 19:22:15.906576 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 31 19:22:15.906576 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 31 19:22:15.906576 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 31 19:22:15.906576 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 31 19:22:15.906576 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 31 19:22:15.906576 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 31 19:22:15.906576 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 31 19:22:15.907760 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 31 19:22:15.907760 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 31 19:22:15.907760 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 31 19:22:15.907760 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 31 19:22:15.907760 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 31 19:22:15.907760 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 824667b0-a097-4973-ae28-66f433797460 could not be found. Oct 31 19:22:15.907760 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:22:15.907760 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 19:22:15.907760 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:22:15.907760 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:22:15.907760 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 19:22:15.907760 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 19:22:15.907760 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 19:22:15.907760 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 19:22:15.907760 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 19:22:15.907760 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 19:22:15.907760 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 19:22:15.907760 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 19:22:15.907760 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Oct 31 19:22:15.907760 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 19:22:15.909752 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 824667b0-a097-4973-ae28-66f433797460 could not be found. Oct 31 19:22:15.909752 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:22:15.909752 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 19:22:15.909752 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:22:15.909752 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:22:15.909752 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 19:22:15.909752 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 19:22:15.909752 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 19:22:15.909752 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 19:22:15.909752 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 824667b0-a097-4973-ae28-66f433797460 could not be found. Oct 31 19:22:15.909752 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:22:15.909752 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-91e9b4b0-0154-4fc6-88ef-1bb031650829 tempest-VolumesSnapshotsTestJSON-213380412 tempest-VolumesSnapshotsTestJSON-213380412-project] Returning 404 to user: Snapshot 824667b0-a097-4973-ae28-66f433797460 could not be found. {{(pid=118727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 19:22:15.909752 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-91e9b4b0-0154-4fc6-88ef-1bb031650829 tempest-VolumesSnapshotsTestJSON-213380412 tempest-VolumesSnapshotsTestJSON-213380412-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/824667b0-a097-4973-ae28-66f433797460" status: 404 len: 111 microversion: 2.1 time: 0.062796 Oct 31 19:22:15.909752 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 107/213] 10.222.0.16 () {58 vars in 1251 bytes} [Mon Oct 31 19:22:15 2022] GET /compute/v2.1/os-snapshots/824667b0-a097-4973-ae28-66f433797460 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 19:22:15.913434 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-db3a4b9b-5c10-444b-b0f6-e3e9d806f64b tempest-VolumesSnapshotsTestJSON-213380412 tempest-VolumesSnapshotsTestJSON-213380412-project] Calling method '.version_select at 0x7f34f2134dc0>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:22:15.976268 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-db3a4b9b-5c10-444b-b0f6-e3e9d806f64b tempest-VolumesSnapshotsTestJSON-213380412 tempest-VolumesSnapshotsTestJSON-213380412-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/3c40adb3-a60e-4531-932a-0968111836c4" status: 202 len: 0 microversion: 2.1 time: 0.067048 Oct 31 19:22:15.976936 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 108/214] 10.222.0.16 () {58 vars in 1248 bytes} [Mon Oct 31 19:22:15 2022] DELETE /compute/v2.1/os-volumes/3c40adb3-a60e-4531-932a-0968111836c4 => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 19:22:15.984785 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-1c186f6f-378f-4fac-bfb0-45139534f7e3 tempest-VolumesSnapshotsTestJSON-213380412 tempest-VolumesSnapshotsTestJSON-213380412-project] Calling method '.version_select at 0x7f34f210aaf0>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:22:16.023216 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-c820af47-9c97-46ce-95f6-ebec0e35f4b7 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc49f9eb3114759b2889ed8972136d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cf63c76fc543428404002ae9a75b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:22:16.033025 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-c820af47-9c97-46ce-95f6-ebec0e35f4b7 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/37698c73-94da-4904-a8d5-636936092fba" status: 200 len: 1520 microversion: 2.1 time: 0.170326 Oct 31 19:22:16.033524 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 107/215] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:22:15 2022] GET /compute/v2.1/servers/37698c73-94da-4904-a8d5-636936092fba => generated 1520 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 19:22:16.035571 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-1c186f6f-378f-4fac-bfb0-45139534f7e3 tempest-VolumesSnapshotsTestJSON-213380412 tempest-VolumesSnapshotsTestJSON-213380412-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/3c40adb3-a60e-4531-932a-0968111836c4" status: 200 len: 345 microversion: 2.1 time: 0.054398 Oct 31 19:22:16.036166 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 109/216] 10.222.0.16 () {58 vars in 1245 bytes} [Mon Oct 31 19:22:15 2022] GET /compute/v2.1/os-volumes/3c40adb3-a60e-4531-932a-0968111836c4 => generated 345 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 19:22:16.233881 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-b23859d1-c0b0-47b2-88b8-efacb25975e5 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:22:16.234545 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-b23859d1-c0b0-47b2-88b8-efacb25975e5 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] [instance: 005f4b9f-db45-4bed-9eba-55b70d6b2229] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:22:16.241403 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-b23859d1-c0b0-47b2-88b8-efacb25975e5 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:16.241912 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-b23859d1-c0b0-47b2-88b8-efacb25975e5 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:16.242343 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-b23859d1-c0b0-47b2-88b8-efacb25975e5 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:16.243028 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-b23859d1-c0b0-47b2-88b8-efacb25975e5 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:16.243480 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-b23859d1-c0b0-47b2-88b8-efacb25975e5 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:16.243924 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-b23859d1-c0b0-47b2-88b8-efacb25975e5 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:16.370911 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-b23859d1-c0b0-47b2-88b8-efacb25975e5 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f250770909504592978a8d8c9fb7d668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f19afdd98f2e4f49935bc8f8cf0211d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:22:16.378526 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-b23859d1-c0b0-47b2-88b8-efacb25975e5 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] 10.222.0.16 "GET /compute/v2.1/servers/005f4b9f-db45-4bed-9eba-55b70d6b2229" status: 200 len: 1315 microversion: 2.1 time: 0.148514 Oct 31 19:22:16.379084 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 108/217] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:22:16 2022] GET /compute/v2.1/servers/005f4b9f-db45-4bed-9eba-55b70d6b2229 => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:22:17.051055 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-4a1c0dc8-59ee-4ec5-ac6b-cd0f6cf7d9d6 tempest-VolumesSnapshotsTestJSON-213380412 tempest-VolumesSnapshotsTestJSON-213380412-project] Calling method '.version_select at 0x7f34f23bba60>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:22:17.056598 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-3b807742-b954-491b-8cfe-b38a34f78077 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:22:17.057430 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-3b807742-b954-491b-8cfe-b38a34f78077 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 37698c73-94da-4904-a8d5-636936092fba] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:22:17.063878 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-3b807742-b954-491b-8cfe-b38a34f78077 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:17.064362 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-3b807742-b954-491b-8cfe-b38a34f78077 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:17.064840 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-3b807742-b954-491b-8cfe-b38a34f78077 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:17.066073 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-3b807742-b954-491b-8cfe-b38a34f78077 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:17.066728 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-3b807742-b954-491b-8cfe-b38a34f78077 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:17.067163 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-3b807742-b954-491b-8cfe-b38a34f78077 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:17.081776 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.wsgi [None req-4a1c0dc8-59ee-4ec5-ac6b-cd0f6cf7d9d6 tempest-VolumesSnapshotsTestJSON-213380412 tempest-VolumesSnapshotsTestJSON-213380412-project] HTTP exception thrown: Volume 3c40adb3-a60e-4531-932a-0968111836c4 could not be found. Oct 31 19:22:17.083609 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-4a1c0dc8-59ee-4ec5-ac6b-cd0f6cf7d9d6 tempest-VolumesSnapshotsTestJSON-213380412 tempest-VolumesSnapshotsTestJSON-213380412-project] Request method failure captured: Oct 31 19:22:17.083609 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: request: GET /compute/v2.1/os-volumes/3c40adb3-a60e-4531-932a-0968111836c4 HTTP/1.1 Oct 31 19:22:17.083609 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Accept: application/json Oct 31 19:22:17.083609 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Accept-Encoding: identity Oct 31 19:22:17.083609 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Connection: close Oct 31 19:22:17.083609 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Content-Length: 0 Oct 31 19:22:17.083609 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Content-Type: application/json Oct 31 19:22:17.083609 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Host: 10.222.0.16 Oct 31 19:22:17.083609 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Openstack-System-Scope: None Oct 31 19:22:17.083609 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: User-Agent: python-urllib3/1.26.12 Oct 31 19:22:17.083609 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Auth-Token: gAAAAABjYCBgh2irmEYIHp5VI0bLonHS2GCisFlMrwjWQDd9XlFH7u-rWAH6T5rDBDGCqK23SZY2kthyCWxx3B5w3K5807Xtg3qoUEBjC96gZs1X87W5WJot2sWIm3sp9-z0Q_ExhCfTjXNIKfishUdmw55O30LVBmobaPGlQVygs3CGC-WsA_4 Oct 31 19:22:17.083609 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Domain-Id: None Oct 31 19:22:17.083609 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Domain-Name: None Oct 31 19:22:17.083609 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Identity-Status: Confirmed Oct 31 19:22:17.083609 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Is-Admin-Project: True Oct 31 19:22:17.083609 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Project-Domain-Id: default Oct 31 19:22:17.083609 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Project-Domain-Name: Default Oct 31 19:22:17.083609 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Project-Id: 7afa2454354541a4955b74a82beb7af5 Oct 31 19:22:17.083609 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-213380412 Oct 31 19:22:17.083609 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Role: member,reader Oct 31 19:22:17.083609 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Roles: member,reader Oct 31 19:22:17.085073 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7afa2454354541a4955b74a82beb7af5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7afa2454354541a4955b74a82beb7af5", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7afa2454354541a4955b74a82beb7af5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7afa2454354541a4955b74a82beb7af5"}]}] Oct 31 19:22:17.085073 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Tenant: tempest-VolumesSnapshotsTestJSON-213380412 Oct 31 19:22:17.085073 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Tenant-Id: 7afa2454354541a4955b74a82beb7af5 Oct 31 19:22:17.085073 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-213380412 Oct 31 19:22:17.085073 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User: tempest-VolumesSnapshotsTestJSON-213380412-project Oct 31 19:22:17.085073 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User-Domain-Id: default Oct 31 19:22:17.085073 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User-Domain-Name: Default Oct 31 19:22:17.085073 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User-Id: 7fbe415527cc4b1ba3255e20105b6b97 Oct 31 19:22:17.085073 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User-Name: tempest-VolumesSnapshotsTestJSON-213380412-project Oct 31 19:22:17.085073 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: method: Oct 31 19:22:17.085073 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: exception: Volume 3c40adb3-a60e-4531-932a-0968111836c4 could not be found. Oct 31 19:22:17.085073 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: action_args: {'id': '3c40adb3-a60e-4531-932a-0968111836c4'} Oct 31 19:22:17.085073 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 19:22:17.086269 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:22:17.086269 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 31 19:22:17.086269 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 31 19:22:17.086269 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 31 19:22:17.086269 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 31 19:22:17.086269 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 31 19:22:17.086269 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 31 19:22:17.086269 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 31 19:22:17.086269 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 31 19:22:17.086269 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 31 19:22:17.086269 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 31 19:22:17.086269 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 31 19:22:17.086269 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 31 19:22:17.086269 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 31 19:22:17.086269 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 31 19:22:17.086269 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3c40adb3-a60e-4531-932a-0968111836c4 could not be found. (HTTP 404) (Request-ID: req-64fc4117-e2b1-41a0-ab82-3cee60461199) Oct 31 19:22:17.086269 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:22:17.086269 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 19:22:17.086269 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:22:17.087905 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:22:17.087905 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 31 19:22:17.087905 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 31 19:22:17.087905 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 31 19:22:17.087905 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 31 19:22:17.087905 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 31 19:22:17.087905 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 31 19:22:17.087905 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 31 19:22:17.087905 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 31 19:22:17.087905 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 31 19:22:17.087905 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 31 19:22:17.087905 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 31 19:22:17.087905 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 31 19:22:17.087905 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 31 19:22:17.087905 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 31 19:22:17.087905 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 31 19:22:17.087905 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 31 19:22:17.087905 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 31 19:22:17.087905 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 31 19:22:17.088970 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 31 19:22:17.088970 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 31 19:22:17.088970 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 31 19:22:17.088970 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 31 19:22:17.088970 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3c40adb3-a60e-4531-932a-0968111836c4 could not be found. Oct 31 19:22:17.088970 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:22:17.088970 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 19:22:17.088970 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:22:17.088970 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:22:17.088970 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 19:22:17.088970 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 19:22:17.088970 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 19:22:17.088970 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 19:22:17.088970 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 19:22:17.088970 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 19:22:17.088970 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 19:22:17.088970 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 19:22:17.088970 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 31 19:22:17.088970 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 19:22:17.090098 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3c40adb3-a60e-4531-932a-0968111836c4 could not be found. Oct 31 19:22:17.090098 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:22:17.090098 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 19:22:17.090098 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:22:17.090098 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:22:17.090098 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 19:22:17.090098 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 19:22:17.090098 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 19:22:17.090098 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 19:22:17.090098 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3c40adb3-a60e-4531-932a-0968111836c4 could not be found. Oct 31 19:22:17.090098 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:22:17.090098 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-4a1c0dc8-59ee-4ec5-ac6b-cd0f6cf7d9d6 tempest-VolumesSnapshotsTestJSON-213380412 tempest-VolumesSnapshotsTestJSON-213380412-project] Returning 404 to user: Volume 3c40adb3-a60e-4531-932a-0968111836c4 could not be found. {{(pid=118727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 19:22:17.090098 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-4a1c0dc8-59ee-4ec5-ac6b-cd0f6cf7d9d6 tempest-VolumesSnapshotsTestJSON-213380412 tempest-VolumesSnapshotsTestJSON-213380412-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/3c40adb3-a60e-4531-932a-0968111836c4" status: 404 len: 109 microversion: 2.1 time: 0.039662 Oct 31 19:22:17.090098 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 110/218] 10.222.0.16 () {58 vars in 1245 bytes} [Mon Oct 31 19:22:17 2022] GET /compute/v2.1/os-volumes/3c40adb3-a60e-4531-932a-0968111836c4 => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 19:22:17.101088 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-7adc0e90-c5c2-4341-9f01-c7e20feda769 tempest-VolumesSnapshotsTestJSON-213380412 tempest-VolumesSnapshotsTestJSON-213380412-project] Calling method '.version_select at 0x7f34f21345e0>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:22:17.135517 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.wsgi [None req-7adc0e90-c5c2-4341-9f01-c7e20feda769 tempest-VolumesSnapshotsTestJSON-213380412 tempest-VolumesSnapshotsTestJSON-213380412-project] HTTP exception thrown: Volume 3c40adb3-a60e-4531-932a-0968111836c4 could not be found. Oct 31 19:22:17.137487 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-7adc0e90-c5c2-4341-9f01-c7e20feda769 tempest-VolumesSnapshotsTestJSON-213380412 tempest-VolumesSnapshotsTestJSON-213380412-project] Request method failure captured: Oct 31 19:22:17.137487 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: request: DELETE /compute/v2.1/os-volumes/3c40adb3-a60e-4531-932a-0968111836c4 HTTP/1.1 Oct 31 19:22:17.137487 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Accept: application/json Oct 31 19:22:17.137487 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Accept-Encoding: identity Oct 31 19:22:17.137487 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Connection: close Oct 31 19:22:17.137487 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Content-Length: 0 Oct 31 19:22:17.137487 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Content-Type: application/json Oct 31 19:22:17.137487 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Host: 10.222.0.16 Oct 31 19:22:17.137487 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Openstack-System-Scope: None Oct 31 19:22:17.137487 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: User-Agent: python-urllib3/1.26.12 Oct 31 19:22:17.137487 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Auth-Token: gAAAAABjYCBgh2irmEYIHp5VI0bLonHS2GCisFlMrwjWQDd9XlFH7u-rWAH6T5rDBDGCqK23SZY2kthyCWxx3B5w3K5807Xtg3qoUEBjC96gZs1X87W5WJot2sWIm3sp9-z0Q_ExhCfTjXNIKfishUdmw55O30LVBmobaPGlQVygs3CGC-WsA_4 Oct 31 19:22:17.137487 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Domain-Id: None Oct 31 19:22:17.137487 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Domain-Name: None Oct 31 19:22:17.137487 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Identity-Status: Confirmed Oct 31 19:22:17.137487 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Is-Admin-Project: True Oct 31 19:22:17.137487 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Project-Domain-Id: default Oct 31 19:22:17.137487 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Project-Domain-Name: Default Oct 31 19:22:17.137487 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Project-Id: 7afa2454354541a4955b74a82beb7af5 Oct 31 19:22:17.137487 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-213380412 Oct 31 19:22:17.137487 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Role: member,reader Oct 31 19:22:17.137487 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Roles: member,reader Oct 31 19:22:17.138780 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7afa2454354541a4955b74a82beb7af5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7afa2454354541a4955b74a82beb7af5", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7afa2454354541a4955b74a82beb7af5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7afa2454354541a4955b74a82beb7af5"}]}] Oct 31 19:22:17.138780 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Tenant: tempest-VolumesSnapshotsTestJSON-213380412 Oct 31 19:22:17.138780 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Tenant-Id: 7afa2454354541a4955b74a82beb7af5 Oct 31 19:22:17.138780 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-213380412 Oct 31 19:22:17.138780 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User: tempest-VolumesSnapshotsTestJSON-213380412-project Oct 31 19:22:17.138780 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User-Domain-Id: default Oct 31 19:22:17.138780 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User-Domain-Name: Default Oct 31 19:22:17.138780 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User-Id: 7fbe415527cc4b1ba3255e20105b6b97 Oct 31 19:22:17.138780 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User-Name: tempest-VolumesSnapshotsTestJSON-213380412-project Oct 31 19:22:17.138780 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: method: Oct 31 19:22:17.138780 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: exception: Volume 3c40adb3-a60e-4531-932a-0968111836c4 could not be found. Oct 31 19:22:17.138780 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: action_args: {'id': '3c40adb3-a60e-4531-932a-0968111836c4'} Oct 31 19:22:17.138780 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 19:22:17.139526 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:22:17.139526 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 31 19:22:17.139526 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 31 19:22:17.139526 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 31 19:22:17.139526 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 31 19:22:17.139526 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 31 19:22:17.139526 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 31 19:22:17.139526 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 31 19:22:17.139526 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 31 19:22:17.139526 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 31 19:22:17.139526 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 31 19:22:17.139526 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 31 19:22:17.139526 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 31 19:22:17.139526 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 31 19:22:17.139526 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 31 19:22:17.139526 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3c40adb3-a60e-4531-932a-0968111836c4 could not be found. (HTTP 404) (Request-ID: req-df079518-85ef-4e6a-8fd4-d10fec8f7d53) Oct 31 19:22:17.139526 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:22:17.139526 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 19:22:17.139526 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:22:17.140595 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:22:17.140595 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 31 19:22:17.140595 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 31 19:22:17.140595 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 31 19:22:17.140595 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 31 19:22:17.140595 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 31 19:22:17.140595 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 31 19:22:17.140595 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 31 19:22:17.140595 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 31 19:22:17.140595 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 31 19:22:17.140595 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 31 19:22:17.140595 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 31 19:22:17.140595 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 31 19:22:17.140595 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 31 19:22:17.140595 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 31 19:22:17.140595 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 31 19:22:17.140595 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 31 19:22:17.140595 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 31 19:22:17.140595 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 31 19:22:17.141743 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 31 19:22:17.141743 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 31 19:22:17.141743 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 31 19:22:17.141743 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 31 19:22:17.141743 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3c40adb3-a60e-4531-932a-0968111836c4 could not be found. Oct 31 19:22:17.141743 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:22:17.141743 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 19:22:17.141743 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:22:17.141743 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:22:17.141743 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 19:22:17.141743 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 19:22:17.141743 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 19:22:17.141743 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 19:22:17.141743 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 19:22:17.141743 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 19:22:17.141743 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 19:22:17.141743 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 19:22:17.141743 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 31 19:22:17.141743 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 19:22:17.142812 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3c40adb3-a60e-4531-932a-0968111836c4 could not be found. Oct 31 19:22:17.142812 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:22:17.142812 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 19:22:17.142812 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:22:17.142812 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:22:17.142812 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 19:22:17.142812 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 19:22:17.142812 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 19:22:17.142812 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 19:22:17.142812 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3c40adb3-a60e-4531-932a-0968111836c4 could not be found. Oct 31 19:22:17.142812 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:22:17.142812 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-7adc0e90-c5c2-4341-9f01-c7e20feda769 tempest-VolumesSnapshotsTestJSON-213380412 tempest-VolumesSnapshotsTestJSON-213380412-project] Returning 404 to user: Volume 3c40adb3-a60e-4531-932a-0968111836c4 could not be found. {{(pid=118727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 19:22:17.142812 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-7adc0e90-c5c2-4341-9f01-c7e20feda769 tempest-VolumesSnapshotsTestJSON-213380412 tempest-VolumesSnapshotsTestJSON-213380412-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/3c40adb3-a60e-4531-932a-0968111836c4" status: 404 len: 109 microversion: 2.1 time: 0.041622 Oct 31 19:22:17.142812 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 111/219] 10.222.0.16 () {58 vars in 1248 bytes} [Mon Oct 31 19:22:17 2022] DELETE /compute/v2.1/os-volumes/3c40adb3-a60e-4531-932a-0968111836c4 => generated 109 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 19:22:17.147515 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-74eee83b-7953-4396-8133-136d710695b1 tempest-VolumesSnapshotsTestJSON-213380412 tempest-VolumesSnapshotsTestJSON-213380412-project] Calling method '.version_select at 0x7f34f2338e50>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:22:17.175860 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.wsgi [None req-74eee83b-7953-4396-8133-136d710695b1 tempest-VolumesSnapshotsTestJSON-213380412 tempest-VolumesSnapshotsTestJSON-213380412-project] HTTP exception thrown: Volume 3c40adb3-a60e-4531-932a-0968111836c4 could not be found. Oct 31 19:22:17.178005 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-74eee83b-7953-4396-8133-136d710695b1 tempest-VolumesSnapshotsTestJSON-213380412 tempest-VolumesSnapshotsTestJSON-213380412-project] Request method failure captured: Oct 31 19:22:17.178005 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: request: GET /compute/v2.1/os-volumes/3c40adb3-a60e-4531-932a-0968111836c4 HTTP/1.1 Oct 31 19:22:17.178005 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Accept: application/json Oct 31 19:22:17.178005 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Accept-Encoding: identity Oct 31 19:22:17.178005 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Connection: close Oct 31 19:22:17.178005 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Content-Length: 0 Oct 31 19:22:17.178005 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Content-Type: application/json Oct 31 19:22:17.178005 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Host: 10.222.0.16 Oct 31 19:22:17.178005 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Openstack-System-Scope: None Oct 31 19:22:17.178005 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: User-Agent: python-urllib3/1.26.12 Oct 31 19:22:17.178005 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Auth-Token: gAAAAABjYCBgh2irmEYIHp5VI0bLonHS2GCisFlMrwjWQDd9XlFH7u-rWAH6T5rDBDGCqK23SZY2kthyCWxx3B5w3K5807Xtg3qoUEBjC96gZs1X87W5WJot2sWIm3sp9-z0Q_ExhCfTjXNIKfishUdmw55O30LVBmobaPGlQVygs3CGC-WsA_4 Oct 31 19:22:17.178005 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Domain-Id: None Oct 31 19:22:17.178005 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Domain-Name: None Oct 31 19:22:17.178005 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Identity-Status: Confirmed Oct 31 19:22:17.178005 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Is-Admin-Project: True Oct 31 19:22:17.178005 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Project-Domain-Id: default Oct 31 19:22:17.178005 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Project-Domain-Name: Default Oct 31 19:22:17.178005 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Project-Id: 7afa2454354541a4955b74a82beb7af5 Oct 31 19:22:17.178005 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-213380412 Oct 31 19:22:17.178005 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Role: member,reader Oct 31 19:22:17.178005 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Roles: member,reader Oct 31 19:22:17.179435 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7afa2454354541a4955b74a82beb7af5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7afa2454354541a4955b74a82beb7af5", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7afa2454354541a4955b74a82beb7af5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7afa2454354541a4955b74a82beb7af5"}]}] Oct 31 19:22:17.179435 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Tenant: tempest-VolumesSnapshotsTestJSON-213380412 Oct 31 19:22:17.179435 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Tenant-Id: 7afa2454354541a4955b74a82beb7af5 Oct 31 19:22:17.179435 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-213380412 Oct 31 19:22:17.179435 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User: tempest-VolumesSnapshotsTestJSON-213380412-project Oct 31 19:22:17.179435 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User-Domain-Id: default Oct 31 19:22:17.179435 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User-Domain-Name: Default Oct 31 19:22:17.179435 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User-Id: 7fbe415527cc4b1ba3255e20105b6b97 Oct 31 19:22:17.179435 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User-Name: tempest-VolumesSnapshotsTestJSON-213380412-project Oct 31 19:22:17.179435 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: method: Oct 31 19:22:17.179435 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: exception: Volume 3c40adb3-a60e-4531-932a-0968111836c4 could not be found. Oct 31 19:22:17.179435 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: action_args: {'id': '3c40adb3-a60e-4531-932a-0968111836c4'} Oct 31 19:22:17.179435 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 19:22:17.180277 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:22:17.180277 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 31 19:22:17.180277 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 31 19:22:17.180277 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 31 19:22:17.180277 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 31 19:22:17.180277 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 31 19:22:17.180277 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 31 19:22:17.180277 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 31 19:22:17.180277 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 31 19:22:17.180277 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 31 19:22:17.180277 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 31 19:22:17.180277 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 31 19:22:17.180277 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 31 19:22:17.180277 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 31 19:22:17.180277 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 31 19:22:17.180277 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3c40adb3-a60e-4531-932a-0968111836c4 could not be found. (HTTP 404) (Request-ID: req-1335ba33-c701-4b46-a172-6a9c8a243198) Oct 31 19:22:17.180277 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:22:17.180277 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 19:22:17.180277 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:22:17.181496 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:22:17.181496 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 31 19:22:17.181496 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 31 19:22:17.181496 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 31 19:22:17.181496 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 31 19:22:17.181496 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 31 19:22:17.181496 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 31 19:22:17.181496 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 31 19:22:17.181496 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 31 19:22:17.181496 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 31 19:22:17.181496 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 31 19:22:17.181496 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 31 19:22:17.181496 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 31 19:22:17.181496 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 31 19:22:17.181496 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 31 19:22:17.181496 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 31 19:22:17.181496 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 31 19:22:17.181496 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 31 19:22:17.181496 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 31 19:22:17.182688 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 31 19:22:17.182688 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 31 19:22:17.182688 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 31 19:22:17.182688 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 31 19:22:17.182688 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3c40adb3-a60e-4531-932a-0968111836c4 could not be found. Oct 31 19:22:17.182688 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:22:17.182688 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 19:22:17.182688 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:22:17.182688 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:22:17.182688 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 19:22:17.182688 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 19:22:17.182688 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 19:22:17.182688 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 19:22:17.182688 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 19:22:17.182688 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 19:22:17.182688 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 19:22:17.182688 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 19:22:17.182688 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 31 19:22:17.182688 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 19:22:17.183924 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3c40adb3-a60e-4531-932a-0968111836c4 could not be found. Oct 31 19:22:17.183924 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:22:17.183924 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 19:22:17.183924 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:22:17.183924 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:22:17.183924 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 19:22:17.183924 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 19:22:17.183924 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 19:22:17.183924 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 19:22:17.183924 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3c40adb3-a60e-4531-932a-0968111836c4 could not be found. Oct 31 19:22:17.183924 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:22:17.183924 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-74eee83b-7953-4396-8133-136d710695b1 tempest-VolumesSnapshotsTestJSON-213380412 tempest-VolumesSnapshotsTestJSON-213380412-project] Returning 404 to user: Volume 3c40adb3-a60e-4531-932a-0968111836c4 could not be found. {{(pid=118727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 19:22:17.183924 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-74eee83b-7953-4396-8133-136d710695b1 tempest-VolumesSnapshotsTestJSON-213380412 tempest-VolumesSnapshotsTestJSON-213380412-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/3c40adb3-a60e-4531-932a-0968111836c4" status: 404 len: 109 microversion: 2.1 time: 0.035460 Oct 31 19:22:17.183924 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 112/220] 10.222.0.16 () {58 vars in 1245 bytes} [Mon Oct 31 19:22:17 2022] GET /compute/v2.1/os-volumes/3c40adb3-a60e-4531-932a-0968111836c4 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 19:22:17.223125 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-3b807742-b954-491b-8cfe-b38a34f78077 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc49f9eb3114759b2889ed8972136d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cf63c76fc543428404002ae9a75b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:22:17.231818 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-3b807742-b954-491b-8cfe-b38a34f78077 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/37698c73-94da-4904-a8d5-636936092fba" status: 200 len: 1500 microversion: 2.1 time: 0.178981 Oct 31 19:22:17.245630 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 109/221] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:22:17 2022] GET /compute/v2.1/servers/37698c73-94da-4904-a8d5-636936092fba => generated 1500 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 19:22:17.258112 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-64073c3d-0d7b-4d62-b9a1-0048aacc2900 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:22:17.258914 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-64073c3d-0d7b-4d62-b9a1-0048aacc2900 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 7a47cd33-e4a0-4b78-9afc-2f371e4a9d10] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:22:17.265639 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-64073c3d-0d7b-4d62-b9a1-0048aacc2900 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:17.266115 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-64073c3d-0d7b-4d62-b9a1-0048aacc2900 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:17.266684 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-64073c3d-0d7b-4d62-b9a1-0048aacc2900 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:17.267385 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-64073c3d-0d7b-4d62-b9a1-0048aacc2900 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:17.267908 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-64073c3d-0d7b-4d62-b9a1-0048aacc2900 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:17.268979 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-64073c3d-0d7b-4d62-b9a1-0048aacc2900 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:17.401281 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-092b5b6d-8c5e-4b3f-b9a7-1af45c2df290 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:22:17.402130 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-092b5b6d-8c5e-4b3f-b9a7-1af45c2df290 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] [instance: 005f4b9f-db45-4bed-9eba-55b70d6b2229] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:22:17.408765 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-092b5b6d-8c5e-4b3f-b9a7-1af45c2df290 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:17.409544 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-092b5b6d-8c5e-4b3f-b9a7-1af45c2df290 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:17.410177 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-092b5b6d-8c5e-4b3f-b9a7-1af45c2df290 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:17.411041 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-092b5b6d-8c5e-4b3f-b9a7-1af45c2df290 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:17.411489 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-092b5b6d-8c5e-4b3f-b9a7-1af45c2df290 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:17.411904 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-092b5b6d-8c5e-4b3f-b9a7-1af45c2df290 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:17.432755 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-64073c3d-0d7b-4d62-b9a1-0048aacc2900 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc49f9eb3114759b2889ed8972136d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cf63c76fc543428404002ae9a75b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:22:17.435666 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG dbcounter [-] [118727] Writing DB stats nova_cell1:SELECT=100 {{(pid=118727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:22:17.448839 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-64073c3d-0d7b-4d62-b9a1-0048aacc2900 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/7a47cd33-e4a0-4b78-9afc-2f371e4a9d10" status: 200 len: 1514 microversion: 2.1 time: 0.196305 Oct 31 19:22:17.450264 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 113/222] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:22:17 2022] GET /compute/v2.1/servers/7a47cd33-e4a0-4b78-9afc-2f371e4a9d10 => generated 1514 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:22:17.609399 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-092b5b6d-8c5e-4b3f-b9a7-1af45c2df290 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f250770909504592978a8d8c9fb7d668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f19afdd98f2e4f49935bc8f8cf0211d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:22:17.618231 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-092b5b6d-8c5e-4b3f-b9a7-1af45c2df290 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] 10.222.0.16 "GET /compute/v2.1/servers/005f4b9f-db45-4bed-9eba-55b70d6b2229" status: 200 len: 1465 microversion: 2.1 time: 0.221342 Oct 31 19:22:17.618821 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 110/223] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:22:17 2022] GET /compute/v2.1/servers/005f4b9f-db45-4bed-9eba-55b70d6b2229 => generated 1465 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:22:17.673950 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-d42ceb3a-5429-4790-85e2-8593e48b80eb tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:22:17.675366 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-d42ceb3a-5429-4790-85e2-8593e48b80eb tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] [instance: 005f4b9f-db45-4bed-9eba-55b70d6b2229] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:22:17.682475 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-d42ceb3a-5429-4790-85e2-8593e48b80eb tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:17.682955 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-d42ceb3a-5429-4790-85e2-8593e48b80eb tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:17.683383 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-d42ceb3a-5429-4790-85e2-8593e48b80eb tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:17.684073 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-d42ceb3a-5429-4790-85e2-8593e48b80eb tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:17.684530 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-d42ceb3a-5429-4790-85e2-8593e48b80eb tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:17.684946 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-d42ceb3a-5429-4790-85e2-8593e48b80eb tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:17.712585 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-d42ceb3a-5429-4790-85e2-8593e48b80eb tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] [instance: 005f4b9f-db45-4bed-9eba-55b70d6b2229] Going to try to terminate instance {{(pid=118727) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 19:22:17.866872 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-d42ceb3a-5429-4790-85e2-8593e48b80eb tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] 10.222.0.16 "DELETE /compute/v2.1/servers/005f4b9f-db45-4bed-9eba-55b70d6b2229" status: 204 len: 0 microversion: 2.1 time: 0.198463 Oct 31 19:22:17.867979 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 114/224] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 31 19:22:17 2022] DELETE /compute/v2.1/servers/005f4b9f-db45-4bed-9eba-55b70d6b2229 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 31 19:22:17.876783 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-a96da070-7290-4c7e-a876-9bb9837215ad tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:22:17.877452 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-a96da070-7290-4c7e-a876-9bb9837215ad tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] [instance: 005f4b9f-db45-4bed-9eba-55b70d6b2229] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:22:17.890273 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-a96da070-7290-4c7e-a876-9bb9837215ad tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:17.891379 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-a96da070-7290-4c7e-a876-9bb9837215ad tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:17.892134 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-a96da070-7290-4c7e-a876-9bb9837215ad tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:17.894331 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-a96da070-7290-4c7e-a876-9bb9837215ad tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:17.894963 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-a96da070-7290-4c7e-a876-9bb9837215ad tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:17.896105 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-a96da070-7290-4c7e-a876-9bb9837215ad tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:18.126649 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-a96da070-7290-4c7e-a876-9bb9837215ad tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f250770909504592978a8d8c9fb7d668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f19afdd98f2e4f49935bc8f8cf0211d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:22:18.136032 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-a96da070-7290-4c7e-a876-9bb9837215ad tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] 10.222.0.16 "GET /compute/v2.1/servers/005f4b9f-db45-4bed-9eba-55b70d6b2229" status: 200 len: 1471 microversion: 2.1 time: 0.263871 Oct 31 19:22:18.136703 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 111/225] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:22:17 2022] GET /compute/v2.1/servers/005f4b9f-db45-4bed-9eba-55b70d6b2229 => generated 1471 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 19:22:19.020102 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-76c94d39-af6f-4c93-a1b3-58f879605a5d tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:22:19.022975 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-76c94d39-af6f-4c93-a1b3-58f879605a5d tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 7a47cd33-e4a0-4b78-9afc-2f371e4a9d10] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:22:19.030731 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-76c94d39-af6f-4c93-a1b3-58f879605a5d tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:19.030731 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-76c94d39-af6f-4c93-a1b3-58f879605a5d tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:19.030731 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-76c94d39-af6f-4c93-a1b3-58f879605a5d tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:19.031731 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-76c94d39-af6f-4c93-a1b3-58f879605a5d tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:19.032301 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-76c94d39-af6f-4c93-a1b3-58f879605a5d tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:19.032851 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-76c94d39-af6f-4c93-a1b3-58f879605a5d tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:19.061546 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.objects.instance [None req-76c94d39-af6f-4c93-a1b3-58f879605a5d tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lazy-loading 'flavor' on Instance uuid 7a47cd33-e4a0-4b78-9afc-2f371e4a9d10 {{(pid=118727) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 19:22:19.159904 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-a73fe54d-7c8c-4f1c-b6cb-b8b43243a687 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:22:19.161538 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-a73fe54d-7c8c-4f1c-b6cb-b8b43243a687 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] [instance: 005f4b9f-db45-4bed-9eba-55b70d6b2229] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:22:19.171605 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-a73fe54d-7c8c-4f1c-b6cb-b8b43243a687 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:19.173994 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-a73fe54d-7c8c-4f1c-b6cb-b8b43243a687 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:19.174463 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-a73fe54d-7c8c-4f1c-b6cb-b8b43243a687 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:19.175180 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-a73fe54d-7c8c-4f1c-b6cb-b8b43243a687 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:19.175636 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-a73fe54d-7c8c-4f1c-b6cb-b8b43243a687 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:19.176057 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-a73fe54d-7c8c-4f1c-b6cb-b8b43243a687 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:19.205065 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-76c94d39-af6f-4c93-a1b3-58f879605a5d tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "POST /compute/v2.1/servers/7a47cd33-e4a0-4b78-9afc-2f371e4a9d10/action" status: 200 len: 32 microversion: 2.1 time: 0.189328 Oct 31 19:22:19.206522 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 115/226] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 31 19:22:19 2022] POST /compute/v2.1/servers/7a47cd33-e4a0-4b78-9afc-2f371e4a9d10/action => generated 32 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 31 19:22:19.228277 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-2af6d01e-f652-4f3c-9041-4021627e9b2f tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:22:19.230898 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-2af6d01e-f652-4f3c-9041-4021627e9b2f tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 7a47cd33-e4a0-4b78-9afc-2f371e4a9d10] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:22:19.249023 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-2af6d01e-f652-4f3c-9041-4021627e9b2f tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:19.250050 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-2af6d01e-f652-4f3c-9041-4021627e9b2f tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:19.252492 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-2af6d01e-f652-4f3c-9041-4021627e9b2f tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:19.257134 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-2af6d01e-f652-4f3c-9041-4021627e9b2f tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:19.257896 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-2af6d01e-f652-4f3c-9041-4021627e9b2f tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:19.261312 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-2af6d01e-f652-4f3c-9041-4021627e9b2f tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:19.362599 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-a73fe54d-7c8c-4f1c-b6cb-b8b43243a687 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f250770909504592978a8d8c9fb7d668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f19afdd98f2e4f49935bc8f8cf0211d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:22:19.372040 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-a73fe54d-7c8c-4f1c-b6cb-b8b43243a687 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] 10.222.0.16 "GET /compute/v2.1/servers/005f4b9f-db45-4bed-9eba-55b70d6b2229" status: 200 len: 1471 microversion: 2.1 time: 0.216007 Oct 31 19:22:19.372899 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 112/227] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:22:19 2022] GET /compute/v2.1/servers/005f4b9f-db45-4bed-9eba-55b70d6b2229 => generated 1471 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:22:19.571245 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-2af6d01e-f652-4f3c-9041-4021627e9b2f tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc49f9eb3114759b2889ed8972136d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cf63c76fc543428404002ae9a75b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:22:19.578884 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-2af6d01e-f652-4f3c-9041-4021627e9b2f tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/7a47cd33-e4a0-4b78-9afc-2f371e4a9d10" status: 200 len: 1520 microversion: 2.1 time: 0.366685 Oct 31 19:22:19.593992 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 116/228] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:22:19 2022] GET /compute/v2.1/servers/7a47cd33-e4a0-4b78-9afc-2f371e4a9d10 => generated 1520 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:22:20.397401 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-9bfe613c-df3c-439a-bf5f-b5f6a97f6165 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:22:20.405882 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-9bfe613c-df3c-439a-bf5f-b5f6a97f6165 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] [instance: 005f4b9f-db45-4bed-9eba-55b70d6b2229] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:22:20.423346 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG dbcounter [-] [118726] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=1 {{(pid=118726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:22:20.426233 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-9bfe613c-df3c-439a-bf5f-b5f6a97f6165 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:20.432496 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-9bfe613c-df3c-439a-bf5f-b5f6a97f6165 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:20.433158 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-9bfe613c-df3c-439a-bf5f-b5f6a97f6165 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:20.435391 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-9bfe613c-df3c-439a-bf5f-b5f6a97f6165 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:20.436705 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-9bfe613c-df3c-439a-bf5f-b5f6a97f6165 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:20.438946 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-9bfe613c-df3c-439a-bf5f-b5f6a97f6165 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:20.474567 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [req-55539154-214c-4e6b-a158-f8762058f0e5 req-b679053f-0c03-43bf-b9b2-2d7293d8184d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "005f4b9f-db45-4bed-9eba-55b70d6b2229", "name": "network-vif-deleted", "tag": "58080e2a-842b-4b20-bd5a-8cca7dca5e72"}]} {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:22:20.496373 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [req-55539154-214c-4e6b-a158-f8762058f0e5 req-b679053f-0c03-43bf-b9b2-2d7293d8184d service nova] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:20.496970 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [req-55539154-214c-4e6b-a158-f8762058f0e5 req-b679053f-0c03-43bf-b9b2-2d7293d8184d service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:20.497487 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [req-55539154-214c-4e6b-a158-f8762058f0e5 req-b679053f-0c03-43bf-b9b2-2d7293d8184d service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:20.575097 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-9bfe613c-df3c-439a-bf5f-b5f6a97f6165 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f250770909504592978a8d8c9fb7d668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f19afdd98f2e4f49935bc8f8cf0211d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:22:20.584577 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-9bfe613c-df3c-439a-bf5f-b5f6a97f6165 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] 10.222.0.16 "GET /compute/v2.1/servers/005f4b9f-db45-4bed-9eba-55b70d6b2229" status: 200 len: 1429 microversion: 2.1 time: 0.191838 Oct 31 19:22:20.585180 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 113/229] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:22:20 2022] GET /compute/v2.1/servers/005f4b9f-db45-4bed-9eba-55b70d6b2229 => generated 1429 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:22:20.606753 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-e35a4a82-71e0-4a00-a9f3-e8318843c139 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:22:20.607556 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-e35a4a82-71e0-4a00-a9f3-e8318843c139 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 7a47cd33-e4a0-4b78-9afc-2f371e4a9d10] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:22:20.623407 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-e35a4a82-71e0-4a00-a9f3-e8318843c139 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:20.632019 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-e35a4a82-71e0-4a00-a9f3-e8318843c139 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:20.632509 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-e35a4a82-71e0-4a00-a9f3-e8318843c139 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:20.633782 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-e35a4a82-71e0-4a00-a9f3-e8318843c139 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:20.634281 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-e35a4a82-71e0-4a00-a9f3-e8318843c139 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:20.634741 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-e35a4a82-71e0-4a00-a9f3-e8318843c139 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:20.724135 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.compute.server_external_events [req-55539154-214c-4e6b-a158-f8762058f0e5 req-b679053f-0c03-43bf-b9b2-2d7293d8184d service nova] Creating event network-vif-deleted:58080e2a-842b-4b20-bd5a-8cca7dca5e72 for instance 005f4b9f-db45-4bed-9eba-55b70d6b2229 on hv-cinder-86309 Oct 31 19:22:20.730491 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [req-55539154-214c-4e6b-a158-f8762058f0e5 req-b679053f-0c03-43bf-b9b2-2d7293d8184d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.260039 Oct 31 19:22:20.731153 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 117/230] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 31 19:22:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:22:20.819281 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-e35a4a82-71e0-4a00-a9f3-e8318843c139 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc49f9eb3114759b2889ed8972136d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cf63c76fc543428404002ae9a75b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:22:20.827174 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-e35a4a82-71e0-4a00-a9f3-e8318843c139 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/7a47cd33-e4a0-4b78-9afc-2f371e4a9d10" status: 200 len: 1520 microversion: 2.1 time: 0.226097 Oct 31 19:22:20.827752 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 114/231] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:22:20 2022] GET /compute/v2.1/servers/7a47cd33-e4a0-4b78-9afc-2f371e4a9d10 => generated 1520 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 19:22:21.611003 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-6043cbfc-5c15-462b-b483-9f7ec52f6097 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:22:21.611628 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-6043cbfc-5c15-462b-b483-9f7ec52f6097 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] [instance: 005f4b9f-db45-4bed-9eba-55b70d6b2229] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:22:21.617629 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-6043cbfc-5c15-462b-b483-9f7ec52f6097 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:21.618129 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-6043cbfc-5c15-462b-b483-9f7ec52f6097 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:21.618561 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-6043cbfc-5c15-462b-b483-9f7ec52f6097 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:21.619244 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-6043cbfc-5c15-462b-b483-9f7ec52f6097 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:21.619696 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-6043cbfc-5c15-462b-b483-9f7ec52f6097 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:21.620118 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-6043cbfc-5c15-462b-b483-9f7ec52f6097 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:21.686676 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-6043cbfc-5c15-462b-b483-9f7ec52f6097 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f250770909504592978a8d8c9fb7d668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f19afdd98f2e4f49935bc8f8cf0211d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:22:21.694852 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-6043cbfc-5c15-462b-b483-9f7ec52f6097 tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] 10.222.0.16 "GET /compute/v2.1/servers/005f4b9f-db45-4bed-9eba-55b70d6b2229" status: 200 len: 1429 microversion: 2.1 time: 0.088137 Oct 31 19:22:21.709632 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 118/232] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:22:21 2022] GET /compute/v2.1/servers/005f4b9f-db45-4bed-9eba-55b70d6b2229 => generated 1429 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:22:21.851648 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-53ef58e6-504a-4496-b808-7cc8c3370b55 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:22:21.852257 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-53ef58e6-504a-4496-b808-7cc8c3370b55 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 7a47cd33-e4a0-4b78-9afc-2f371e4a9d10] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:22:21.858627 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-53ef58e6-504a-4496-b808-7cc8c3370b55 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:21.859132 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-53ef58e6-504a-4496-b808-7cc8c3370b55 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:21.859532 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-53ef58e6-504a-4496-b808-7cc8c3370b55 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:21.860218 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-53ef58e6-504a-4496-b808-7cc8c3370b55 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:21.860675 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-53ef58e6-504a-4496-b808-7cc8c3370b55 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:21.861165 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-53ef58e6-504a-4496-b808-7cc8c3370b55 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:21.993370 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-53ef58e6-504a-4496-b808-7cc8c3370b55 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc49f9eb3114759b2889ed8972136d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cf63c76fc543428404002ae9a75b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:22:22.001138 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-53ef58e6-504a-4496-b808-7cc8c3370b55 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/7a47cd33-e4a0-4b78-9afc-2f371e4a9d10" status: 200 len: 1520 microversion: 2.1 time: 0.153480 Oct 31 19:22:22.001761 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 115/233] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:22:21 2022] GET /compute/v2.1/servers/7a47cd33-e4a0-4b78-9afc-2f371e4a9d10 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:22:22.720154 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-ec47dc35-7952-49eb-b7c0-7fed1e4a591a tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:22:22.721754 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-ec47dc35-7952-49eb-b7c0-7fed1e4a591a tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] [instance: 005f4b9f-db45-4bed-9eba-55b70d6b2229] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:22:22.735697 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-ec47dc35-7952-49eb-b7c0-7fed1e4a591a tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:22.736206 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-ec47dc35-7952-49eb-b7c0-7fed1e4a591a tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:22.737848 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-ec47dc35-7952-49eb-b7c0-7fed1e4a591a tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:22.738625 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-ec47dc35-7952-49eb-b7c0-7fed1e4a591a tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:22.740477 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-ec47dc35-7952-49eb-b7c0-7fed1e4a591a tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:22.741468 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-ec47dc35-7952-49eb-b7c0-7fed1e4a591a tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:22.872486 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-ec47dc35-7952-49eb-b7c0-7fed1e4a591a tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f250770909504592978a8d8c9fb7d668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f19afdd98f2e4f49935bc8f8cf0211d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:22:22.880837 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-ec47dc35-7952-49eb-b7c0-7fed1e4a591a tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] 10.222.0.16 "GET /compute/v2.1/servers/005f4b9f-db45-4bed-9eba-55b70d6b2229" status: 200 len: 1300 microversion: 2.1 time: 0.165679 Oct 31 19:22:22.881390 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 119/234] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:22:22 2022] GET /compute/v2.1/servers/005f4b9f-db45-4bed-9eba-55b70d6b2229 => generated 1300 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:22:23.025115 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-5739f77f-164f-4e55-b384-698b530d6936 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:22:23.025886 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-5739f77f-164f-4e55-b384-698b530d6936 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 7a47cd33-e4a0-4b78-9afc-2f371e4a9d10] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:22:23.032862 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-5739f77f-164f-4e55-b384-698b530d6936 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:23.033416 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-5739f77f-164f-4e55-b384-698b530d6936 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:23.034499 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-5739f77f-164f-4e55-b384-698b530d6936 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:23.035262 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-5739f77f-164f-4e55-b384-698b530d6936 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:23.035787 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-5739f77f-164f-4e55-b384-698b530d6936 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:23.036279 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-5739f77f-164f-4e55-b384-698b530d6936 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:23.259849 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-5739f77f-164f-4e55-b384-698b530d6936 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc49f9eb3114759b2889ed8972136d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cf63c76fc543428404002ae9a75b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:22:23.268038 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-5739f77f-164f-4e55-b384-698b530d6936 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/7a47cd33-e4a0-4b78-9afc-2f371e4a9d10" status: 200 len: 1520 microversion: 2.1 time: 0.247872 Oct 31 19:22:23.268683 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 116/235] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:22:23 2022] GET /compute/v2.1/servers/7a47cd33-e4a0-4b78-9afc-2f371e4a9d10 => generated 1520 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 19:22:23.908683 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-77ed8b1b-77d0-4f90-afa4-0aba2c6fbe2f tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:22:23.911594 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-77ed8b1b-77d0-4f90-afa4-0aba2c6fbe2f tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] [instance: 005f4b9f-db45-4bed-9eba-55b70d6b2229] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:22:23.919100 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-77ed8b1b-77d0-4f90-afa4-0aba2c6fbe2f tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:23.919767 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-77ed8b1b-77d0-4f90-afa4-0aba2c6fbe2f tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:23.921228 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-77ed8b1b-77d0-4f90-afa4-0aba2c6fbe2f tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:23.922149 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-77ed8b1b-77d0-4f90-afa4-0aba2c6fbe2f tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:23.922891 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-77ed8b1b-77d0-4f90-afa4-0aba2c6fbe2f tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:23.923467 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-77ed8b1b-77d0-4f90-afa4-0aba2c6fbe2f tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:23.939205 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.wsgi [None req-77ed8b1b-77d0-4f90-afa4-0aba2c6fbe2f tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] HTTP exception thrown: Instance 005f4b9f-db45-4bed-9eba-55b70d6b2229 could not be found. Oct 31 19:22:23.942036 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-77ed8b1b-77d0-4f90-afa4-0aba2c6fbe2f tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Request method failure captured: Oct 31 19:22:23.942036 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: request: GET /compute/v2.1/servers/005f4b9f-db45-4bed-9eba-55b70d6b2229 HTTP/1.1 Oct 31 19:22:23.942036 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Accept: application/json Oct 31 19:22:23.942036 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Accept-Encoding: identity Oct 31 19:22:23.942036 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Connection: close Oct 31 19:22:23.942036 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Content-Length: 0 Oct 31 19:22:23.942036 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Content-Type: application/json Oct 31 19:22:23.942036 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Host: 10.222.0.16 Oct 31 19:22:23.942036 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Openstack-System-Scope: None Oct 31 19:22:23.942036 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: User-Agent: python-urllib3/1.26.12 Oct 31 19:22:23.942036 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Auth-Token: gAAAAABjYCBMMKUMCI7gEtSqLtuw4VJeEGZc8EnVixRcrwwCAm48nG0o_e8gG9jRJ2WCcGzG0aYl_BiQvB5zxYZaie6X8PqjcadOc5HboPYptxAS02D7sdiVPg15KCJiWtap-4bY_W83SiAppzEL7j1yHbcoDtZ5SQf0UZvbFla7wdQEK_QHE5I Oct 31 19:22:23.942036 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Domain-Id: None Oct 31 19:22:23.942036 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Domain-Name: None Oct 31 19:22:23.942036 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Identity-Status: Confirmed Oct 31 19:22:23.942036 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Is-Admin-Project: True Oct 31 19:22:23.942036 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Project-Domain-Id: default Oct 31 19:22:23.942036 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Project-Domain-Name: Default Oct 31 19:22:23.942036 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Project-Id: f19afdd98f2e4f49935bc8f8cf0211d4 Oct 31 19:22:23.942036 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Project-Name: tempest-VolumesNegativeTest-958343777 Oct 31 19:22:23.942036 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Role: member,reader Oct 31 19:22:23.942036 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Roles: member,reader Oct 31 19:22:23.943573 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f19afdd98f2e4f49935bc8f8cf0211d4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f19afdd98f2e4f49935bc8f8cf0211d4", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f19afdd98f2e4f49935bc8f8cf0211d4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f19afdd98f2e4f49935bc8f8cf0211d4"}]}] Oct 31 19:22:23.943573 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Tenant: tempest-VolumesNegativeTest-958343777 Oct 31 19:22:23.943573 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Tenant-Id: f19afdd98f2e4f49935bc8f8cf0211d4 Oct 31 19:22:23.943573 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Tenant-Name: tempest-VolumesNegativeTest-958343777 Oct 31 19:22:23.943573 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User: tempest-VolumesNegativeTest-958343777-project Oct 31 19:22:23.943573 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User-Domain-Id: default Oct 31 19:22:23.943573 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User-Domain-Name: Default Oct 31 19:22:23.943573 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User-Id: f250770909504592978a8d8c9fb7d668 Oct 31 19:22:23.943573 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User-Name: tempest-VolumesNegativeTest-958343777-project Oct 31 19:22:23.943573 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: method: > Oct 31 19:22:23.943573 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: exception: Instance 005f4b9f-db45-4bed-9eba-55b70d6b2229 could not be found. Oct 31 19:22:23.943573 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: action_args: {'id': '005f4b9f-db45-4bed-9eba-55b70d6b2229'} Oct 31 19:22:23.944502 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 19:22:23.944502 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:22:23.944502 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 19:22:23.944502 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 19:22:23.944502 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 19:22:23.944502 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 19:22:23.944502 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 19:22:23.944502 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 19:22:23.944502 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 19:22:23.944502 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 19:22:23.944502 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 005f4b9f-db45-4bed-9eba-55b70d6b2229 could not be found. Oct 31 19:22:23.944502 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:22:23.944502 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 19:22:23.944502 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:22:23.944502 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:22:23.944502 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 19:22:23.944502 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 19:22:23.944502 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 19:22:23.944502 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 19:22:23.944502 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 19:22:23.945792 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 19:22:23.945792 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 19:22:23.945792 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 19:22:23.945792 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 19:22:23.945792 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 19:22:23.945792 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 19:22:23.945792 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 19:22:23.945792 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 005f4b9f-db45-4bed-9eba-55b70d6b2229 could not be found. Oct 31 19:22:23.945792 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:22:23.945792 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 19:22:23.945792 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:22:23.945792 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:22:23.945792 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 19:22:23.945792 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 19:22:23.945792 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 19:22:23.945792 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 19:22:23.945792 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 005f4b9f-db45-4bed-9eba-55b70d6b2229 could not be found. Oct 31 19:22:23.945792 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:22:23.947350 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-77ed8b1b-77d0-4f90-afa4-0aba2c6fbe2f tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] Returning 404 to user: Instance 005f4b9f-db45-4bed-9eba-55b70d6b2229 could not be found. {{(pid=118727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 19:22:23.947350 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-77ed8b1b-77d0-4f90-afa4-0aba2c6fbe2f tempest-VolumesNegativeTest-958343777 tempest-VolumesNegativeTest-958343777-project] 10.222.0.16 "GET /compute/v2.1/servers/005f4b9f-db45-4bed-9eba-55b70d6b2229" status: 404 len: 111 microversion: 2.1 time: 0.042697 Oct 31 19:22:23.947350 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 120/236] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:22:23 2022] GET /compute/v2.1/servers/005f4b9f-db45-4bed-9eba-55b70d6b2229 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 19:22:24.292081 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-93046310-2588-4e8b-ab17-cf775a45462d tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:22:24.292733 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-93046310-2588-4e8b-ab17-cf775a45462d tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 7a47cd33-e4a0-4b78-9afc-2f371e4a9d10] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:22:24.300560 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-93046310-2588-4e8b-ab17-cf775a45462d tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:24.301250 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-93046310-2588-4e8b-ab17-cf775a45462d tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:24.301812 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-93046310-2588-4e8b-ab17-cf775a45462d tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:24.302542 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-93046310-2588-4e8b-ab17-cf775a45462d tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:24.303000 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-93046310-2588-4e8b-ab17-cf775a45462d tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:24.303424 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-93046310-2588-4e8b-ab17-cf775a45462d tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:24.511996 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-93046310-2588-4e8b-ab17-cf775a45462d tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc49f9eb3114759b2889ed8972136d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cf63c76fc543428404002ae9a75b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:22:24.521408 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-93046310-2588-4e8b-ab17-cf775a45462d tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/7a47cd33-e4a0-4b78-9afc-2f371e4a9d10" status: 200 len: 1520 microversion: 2.1 time: 0.233994 Oct 31 19:22:24.529680 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 117/237] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:22:24 2022] GET /compute/v2.1/servers/7a47cd33-e4a0-4b78-9afc-2f371e4a9d10 => generated 1520 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:22:25.548213 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-240ff488-594b-40de-8a14-918f025ecfce tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:22:25.548909 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-240ff488-594b-40de-8a14-918f025ecfce tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 7a47cd33-e4a0-4b78-9afc-2f371e4a9d10] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:22:25.559257 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-240ff488-594b-40de-8a14-918f025ecfce tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:25.559836 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-240ff488-594b-40de-8a14-918f025ecfce tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:25.560361 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-240ff488-594b-40de-8a14-918f025ecfce tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:25.561293 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-240ff488-594b-40de-8a14-918f025ecfce tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:25.563066 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-240ff488-594b-40de-8a14-918f025ecfce tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:25.563939 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-240ff488-594b-40de-8a14-918f025ecfce tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:25.781344 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-240ff488-594b-40de-8a14-918f025ecfce tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc49f9eb3114759b2889ed8972136d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cf63c76fc543428404002ae9a75b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:22:25.793177 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-240ff488-594b-40de-8a14-918f025ecfce tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/7a47cd33-e4a0-4b78-9afc-2f371e4a9d10" status: 200 len: 1520 microversion: 2.1 time: 0.249061 Oct 31 19:22:25.807220 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 121/238] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:22:25 2022] GET /compute/v2.1/servers/7a47cd33-e4a0-4b78-9afc-2f371e4a9d10 => generated 1520 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:22:26.819594 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-fe7a0bde-f823-4611-9ecc-25d8efcf5908 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:22:26.820200 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-fe7a0bde-f823-4611-9ecc-25d8efcf5908 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 7a47cd33-e4a0-4b78-9afc-2f371e4a9d10] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:22:26.833495 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-fe7a0bde-f823-4611-9ecc-25d8efcf5908 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:26.834015 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-fe7a0bde-f823-4611-9ecc-25d8efcf5908 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:26.834453 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-fe7a0bde-f823-4611-9ecc-25d8efcf5908 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:26.835158 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-fe7a0bde-f823-4611-9ecc-25d8efcf5908 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:26.835626 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-fe7a0bde-f823-4611-9ecc-25d8efcf5908 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:26.836032 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-fe7a0bde-f823-4611-9ecc-25d8efcf5908 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:27.162496 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-fe7a0bde-f823-4611-9ecc-25d8efcf5908 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc49f9eb3114759b2889ed8972136d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cf63c76fc543428404002ae9a75b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:22:27.178218 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-fe7a0bde-f823-4611-9ecc-25d8efcf5908 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/7a47cd33-e4a0-4b78-9afc-2f371e4a9d10" status: 200 len: 1520 microversion: 2.1 time: 0.362917 Oct 31 19:22:27.180930 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 118/239] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:22:26 2022] GET /compute/v2.1/servers/7a47cd33-e4a0-4b78-9afc-2f371e4a9d10 => generated 1520 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:22:28.205030 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-cc884a35-e6f9-4ffb-8c69-c1c675ef764d tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:22:28.208337 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-cc884a35-e6f9-4ffb-8c69-c1c675ef764d tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 7a47cd33-e4a0-4b78-9afc-2f371e4a9d10] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:22:28.219913 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-cc884a35-e6f9-4ffb-8c69-c1c675ef764d tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:28.220407 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-cc884a35-e6f9-4ffb-8c69-c1c675ef764d tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:28.220937 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-cc884a35-e6f9-4ffb-8c69-c1c675ef764d tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:28.222251 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-cc884a35-e6f9-4ffb-8c69-c1c675ef764d tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:28.222707 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-cc884a35-e6f9-4ffb-8c69-c1c675ef764d tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:28.223480 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-cc884a35-e6f9-4ffb-8c69-c1c675ef764d tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:28.538251 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-cc884a35-e6f9-4ffb-8c69-c1c675ef764d tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc49f9eb3114759b2889ed8972136d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cf63c76fc543428404002ae9a75b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:22:28.549749 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-cc884a35-e6f9-4ffb-8c69-c1c675ef764d tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/7a47cd33-e4a0-4b78-9afc-2f371e4a9d10" status: 200 len: 1520 microversion: 2.1 time: 0.349493 Oct 31 19:22:28.555572 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 122/240] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:22:28 2022] GET /compute/v2.1/servers/7a47cd33-e4a0-4b78-9afc-2f371e4a9d10 => generated 1520 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:22:29.582524 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-90508f75-fba8-4ad9-be65-e57ee7c2eebe tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:22:29.583820 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-90508f75-fba8-4ad9-be65-e57ee7c2eebe tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 7a47cd33-e4a0-4b78-9afc-2f371e4a9d10] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:22:29.610337 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-90508f75-fba8-4ad9-be65-e57ee7c2eebe tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:29.612826 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-90508f75-fba8-4ad9-be65-e57ee7c2eebe tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:29.613474 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-90508f75-fba8-4ad9-be65-e57ee7c2eebe tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:29.615449 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-90508f75-fba8-4ad9-be65-e57ee7c2eebe tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:29.616105 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-90508f75-fba8-4ad9-be65-e57ee7c2eebe tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:29.624395 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-90508f75-fba8-4ad9-be65-e57ee7c2eebe tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:29.660912 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG dbcounter [-] [118726] Writing DB stats nova_cell1:SELECT=100 {{(pid=118726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:22:29.905702 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-90508f75-fba8-4ad9-be65-e57ee7c2eebe tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc49f9eb3114759b2889ed8972136d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cf63c76fc543428404002ae9a75b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:22:29.917639 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-90508f75-fba8-4ad9-be65-e57ee7c2eebe tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/7a47cd33-e4a0-4b78-9afc-2f371e4a9d10" status: 200 len: 1520 microversion: 2.1 time: 0.339068 Oct 31 19:22:29.919204 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 119/241] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:22:29 2022] GET /compute/v2.1/servers/7a47cd33-e4a0-4b78-9afc-2f371e4a9d10 => generated 1520 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:22:30.951715 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-854ab22b-1348-4830-98d3-a19f1b535d42 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:22:30.952656 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-854ab22b-1348-4830-98d3-a19f1b535d42 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 7a47cd33-e4a0-4b78-9afc-2f371e4a9d10] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:22:30.967393 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-854ab22b-1348-4830-98d3-a19f1b535d42 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:30.970400 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-854ab22b-1348-4830-98d3-a19f1b535d42 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:30.970985 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-854ab22b-1348-4830-98d3-a19f1b535d42 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:30.972805 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-854ab22b-1348-4830-98d3-a19f1b535d42 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:30.973409 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-854ab22b-1348-4830-98d3-a19f1b535d42 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:30.975109 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-854ab22b-1348-4830-98d3-a19f1b535d42 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:31.536744 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-854ab22b-1348-4830-98d3-a19f1b535d42 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc49f9eb3114759b2889ed8972136d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cf63c76fc543428404002ae9a75b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:22:31.545807 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-854ab22b-1348-4830-98d3-a19f1b535d42 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/7a47cd33-e4a0-4b78-9afc-2f371e4a9d10" status: 200 len: 1520 microversion: 2.1 time: 0.603151 Oct 31 19:22:31.558203 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 123/242] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:22:30 2022] GET /compute/v2.1/servers/7a47cd33-e4a0-4b78-9afc-2f371e4a9d10 => generated 1520 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:22:32.572537 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-860059be-8b99-48f1-a97e-6904a682ad08 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:22:32.573888 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-860059be-8b99-48f1-a97e-6904a682ad08 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 7a47cd33-e4a0-4b78-9afc-2f371e4a9d10] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:22:32.584345 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-860059be-8b99-48f1-a97e-6904a682ad08 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:32.586264 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-860059be-8b99-48f1-a97e-6904a682ad08 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:32.587989 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-860059be-8b99-48f1-a97e-6904a682ad08 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:32.592310 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-860059be-8b99-48f1-a97e-6904a682ad08 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:32.593150 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-860059be-8b99-48f1-a97e-6904a682ad08 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:32.593805 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-860059be-8b99-48f1-a97e-6904a682ad08 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:33.124120 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-860059be-8b99-48f1-a97e-6904a682ad08 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc49f9eb3114759b2889ed8972136d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cf63c76fc543428404002ae9a75b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:22:33.137849 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-860059be-8b99-48f1-a97e-6904a682ad08 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/7a47cd33-e4a0-4b78-9afc-2f371e4a9d10" status: 200 len: 1520 microversion: 2.1 time: 0.569337 Oct 31 19:22:33.141793 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 120/243] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:22:32 2022] GET /compute/v2.1/servers/7a47cd33-e4a0-4b78-9afc-2f371e4a9d10 => generated 1520 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:22:34.131003 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-f7a50ab6-89d0-4b9e-9f26-0ad97a09045a tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:22:34.131506 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-f7a50ab6-89d0-4b9e-9f26-0ad97a09045a tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 24ad6e3e-6043-4eff-afb4-0c6039e825fa] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:22:34.141416 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG dbcounter [-] [118727] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=118727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:22:34.150896 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-f7a50ab6-89d0-4b9e-9f26-0ad97a09045a tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:34.151428 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-f7a50ab6-89d0-4b9e-9f26-0ad97a09045a tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:34.151877 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-f7a50ab6-89d0-4b9e-9f26-0ad97a09045a tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:34.152623 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-f7a50ab6-89d0-4b9e-9f26-0ad97a09045a tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:34.153082 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-f7a50ab6-89d0-4b9e-9f26-0ad97a09045a tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:34.153817 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-f7a50ab6-89d0-4b9e-9f26-0ad97a09045a tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:34.163644 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-4ded3ef8-440d-4398-9272-1d0a6f5fabfa tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:22:34.164971 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-4ded3ef8-440d-4398-9272-1d0a6f5fabfa tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 7a47cd33-e4a0-4b78-9afc-2f371e4a9d10] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:22:34.193074 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-4ded3ef8-440d-4398-9272-1d0a6f5fabfa tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:34.194131 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-4ded3ef8-440d-4398-9272-1d0a6f5fabfa tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:34.194800 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-4ded3ef8-440d-4398-9272-1d0a6f5fabfa tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:34.195909 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-4ded3ef8-440d-4398-9272-1d0a6f5fabfa tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:34.196732 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-4ded3ef8-440d-4398-9272-1d0a6f5fabfa tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:34.197475 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-4ded3ef8-440d-4398-9272-1d0a6f5fabfa tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:34.238545 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-f7a50ab6-89d0-4b9e-9f26-0ad97a09045a tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa/ips" status: 200 len: 152 microversion: 2.20 time: 0.111583 Oct 31 19:22:34.249392 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 124/244] 10.222.0.16 () {60 vars in 1289 bytes} [Mon Oct 31 19:22:34 2022] GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa/ips => generated 152 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 19:22:34.795083 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-4ded3ef8-440d-4398-9272-1d0a6f5fabfa tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc49f9eb3114759b2889ed8972136d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cf63c76fc543428404002ae9a75b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:22:34.808292 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-4ded3ef8-440d-4398-9272-1d0a6f5fabfa tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/7a47cd33-e4a0-4b78-9afc-2f371e4a9d10" status: 200 len: 1520 microversion: 2.1 time: 0.649716 Oct 31 19:22:34.813379 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 121/245] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:22:34 2022] GET /compute/v2.1/servers/7a47cd33-e4a0-4b78-9afc-2f371e4a9d10 => generated 1520 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 19:22:35.839821 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-20dbc518-ffac-4c2e-b7bb-686b1680e7a4 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:22:35.840617 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-20dbc518-ffac-4c2e-b7bb-686b1680e7a4 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 7a47cd33-e4a0-4b78-9afc-2f371e4a9d10] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:22:35.849947 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-20dbc518-ffac-4c2e-b7bb-686b1680e7a4 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:35.860809 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-20dbc518-ffac-4c2e-b7bb-686b1680e7a4 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:35.862833 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-20dbc518-ffac-4c2e-b7bb-686b1680e7a4 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:35.863924 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-20dbc518-ffac-4c2e-b7bb-686b1680e7a4 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:35.864668 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-20dbc518-ffac-4c2e-b7bb-686b1680e7a4 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:35.867822 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-20dbc518-ffac-4c2e-b7bb-686b1680e7a4 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:36.719832 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-20dbc518-ffac-4c2e-b7bb-686b1680e7a4 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc49f9eb3114759b2889ed8972136d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cf63c76fc543428404002ae9a75b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:22:36.728480 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-20dbc518-ffac-4c2e-b7bb-686b1680e7a4 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/7a47cd33-e4a0-4b78-9afc-2f371e4a9d10" status: 200 len: 1520 microversion: 2.1 time: 0.892481 Oct 31 19:22:36.733749 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 125/246] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:22:35 2022] GET /compute/v2.1/servers/7a47cd33-e4a0-4b78-9afc-2f371e4a9d10 => generated 1520 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:22:37.650438 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-700e2bd6-58d3-4388-a5c1-23f8e5eccb6b tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:22:37.651182 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-700e2bd6-58d3-4388-a5c1-23f8e5eccb6b tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 24ad6e3e-6043-4eff-afb4-0c6039e825fa] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:22:37.675915 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-700e2bd6-58d3-4388-a5c1-23f8e5eccb6b tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:37.678145 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-700e2bd6-58d3-4388-a5c1-23f8e5eccb6b tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:37.678804 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-700e2bd6-58d3-4388-a5c1-23f8e5eccb6b tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:37.679941 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-700e2bd6-58d3-4388-a5c1-23f8e5eccb6b tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:37.680617 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-700e2bd6-58d3-4388-a5c1-23f8e5eccb6b tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:37.681276 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-700e2bd6-58d3-4388-a5c1-23f8e5eccb6b tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:37.715130 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.objects.instance [None req-700e2bd6-58d3-4388-a5c1-23f8e5eccb6b tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lazy-loading 'flavor' on Instance uuid 24ad6e3e-6043-4eff-afb4-0c6039e825fa {{(pid=118726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 19:22:37.754840 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-7e19faaf-0734-48f4-a9b9-2b6e5811fdbc tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:22:37.756019 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-7e19faaf-0734-48f4-a9b9-2b6e5811fdbc tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 7a47cd33-e4a0-4b78-9afc-2f371e4a9d10] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:22:37.773314 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-7e19faaf-0734-48f4-a9b9-2b6e5811fdbc tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:37.774187 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-7e19faaf-0734-48f4-a9b9-2b6e5811fdbc tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:37.774831 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-7e19faaf-0734-48f4-a9b9-2b6e5811fdbc tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:37.775761 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-7e19faaf-0734-48f4-a9b9-2b6e5811fdbc tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:37.776444 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-7e19faaf-0734-48f4-a9b9-2b6e5811fdbc tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:37.777071 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-7e19faaf-0734-48f4-a9b9-2b6e5811fdbc tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:38.218813 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-700e2bd6-58d3-4388-a5c1-23f8e5eccb6b tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "POST /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa/action" status: 202 len: 0 microversion: 2.20 time: 0.572761 Oct 31 19:22:38.219550 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 122/247] 10.222.0.16 () {62 vars in 1319 bytes} [Mon Oct 31 19:22:37 2022] POST /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa/action => generated 0 bytes in 575 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 31 19:22:38.242492 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-7e19faaf-0734-48f4-a9b9-2b6e5811fdbc tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc49f9eb3114759b2889ed8972136d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cf63c76fc543428404002ae9a75b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:22:38.262790 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-7e19faaf-0734-48f4-a9b9-2b6e5811fdbc tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/7a47cd33-e4a0-4b78-9afc-2f371e4a9d10" status: 200 len: 1520 microversion: 2.1 time: 0.515344 Oct 31 19:22:38.263713 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 126/248] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:22:37 2022] GET /compute/v2.1/servers/7a47cd33-e4a0-4b78-9afc-2f371e4a9d10 => generated 1520 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:22:38.279164 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-180b34ac-6b81-4c31-a9e6-551d2b0f6892 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:22:38.280165 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-180b34ac-6b81-4c31-a9e6-551d2b0f6892 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 24ad6e3e-6043-4eff-afb4-0c6039e825fa] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:22:38.289153 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-180b34ac-6b81-4c31-a9e6-551d2b0f6892 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:38.290090 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-180b34ac-6b81-4c31-a9e6-551d2b0f6892 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:38.290809 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-180b34ac-6b81-4c31-a9e6-551d2b0f6892 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:38.292127 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-180b34ac-6b81-4c31-a9e6-551d2b0f6892 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:38.293167 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-180b34ac-6b81-4c31-a9e6-551d2b0f6892 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:38.294085 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-180b34ac-6b81-4c31-a9e6-551d2b0f6892 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:38.680398 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-51470ac6-c182-4e81-9c60-28255af95544 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Action: 'create', calling method: .version_select at 0x7f34f22941f0>, body: {"keypair": {"name": "tempest-TestShelveInstance-563463545", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP7Fv1YHV0eD/KmARaScMvmvke59Xpe+nG69zwoMd8ASX7yZa+kjBwXN7he6PQo+oK0wRzVapv6+7Dsncot6Xjjjefj/uKeaGCwHjhgX4wI5A8pPttxnUWlsJxjdWYc6ew=="}} {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:22:38.711546 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.quota [None req-51470ac6-c182-4e81-9c60-28255af95544 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Getting quotas for project a33bb29688304d0dae3cfdc0eb54b7be. Resources: {'key_pairs'} {{(pid=118726) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 19:22:38.717209 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.quota [None req-51470ac6-c182-4e81-9c60-28255af95544 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Getting quotas for user d5cfee7994ab404d974d86d77e075209 and project a33bb29688304d0dae3cfdc0eb54b7be. Resources: {'key_pairs'} {{(pid=118726) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 19:22:38.786610 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-51470ac6-c182-4e81-9c60-28255af95544 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.564624 Oct 31 19:22:38.803792 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 123/249] 10.222.0.16 () {60 vars in 1159 bytes} [Mon Oct 31 19:22:38 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:22:38.941243 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-180b34ac-6b81-4c31-a9e6-551d2b0f6892 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:22:38.956061 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-180b34ac-6b81-4c31-a9e6-551d2b0f6892 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:22:38.962588 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-180b34ac-6b81-4c31-a9e6-551d2b0f6892 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:22:38.966620 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-180b34ac-6b81-4c31-a9e6-551d2b0f6892 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa" status: 200 len: 1724 microversion: 2.20 time: 0.699986 Oct 31 19:22:38.970589 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 127/250] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 31 19:22:38 2022] GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa => generated 1724 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 19:22:39.299928 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-35ceccf8-46c5-4c5a-978d-26fa5caeacbb tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:22:39.302018 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-35ceccf8-46c5-4c5a-978d-26fa5caeacbb tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 7a47cd33-e4a0-4b78-9afc-2f371e4a9d10] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:22:39.336012 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-35ceccf8-46c5-4c5a-978d-26fa5caeacbb tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:39.342756 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-35ceccf8-46c5-4c5a-978d-26fa5caeacbb tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:39.344764 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-35ceccf8-46c5-4c5a-978d-26fa5caeacbb tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:39.350473 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-35ceccf8-46c5-4c5a-978d-26fa5caeacbb tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:39.351427 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-35ceccf8-46c5-4c5a-978d-26fa5caeacbb tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:39.366921 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-35ceccf8-46c5-4c5a-978d-26fa5caeacbb tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:39.648217 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-35ceccf8-46c5-4c5a-978d-26fa5caeacbb tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc49f9eb3114759b2889ed8972136d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cf63c76fc543428404002ae9a75b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:22:39.666043 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-35ceccf8-46c5-4c5a-978d-26fa5caeacbb tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/7a47cd33-e4a0-4b78-9afc-2f371e4a9d10" status: 200 len: 1520 microversion: 2.1 time: 0.374403 Oct 31 19:22:39.667644 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 124/251] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:22:39 2022] GET /compute/v2.1/servers/7a47cd33-e4a0-4b78-9afc-2f371e4a9d10 => generated 1520 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:22:40.000735 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-47b409c2-858d-409f-82af-d31bb341f9ca tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:22:40.002761 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-47b409c2-858d-409f-82af-d31bb341f9ca tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 24ad6e3e-6043-4eff-afb4-0c6039e825fa] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:22:40.032609 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-47b409c2-858d-409f-82af-d31bb341f9ca tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:40.034324 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-47b409c2-858d-409f-82af-d31bb341f9ca tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:40.035185 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-47b409c2-858d-409f-82af-d31bb341f9ca tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:40.036212 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-47b409c2-858d-409f-82af-d31bb341f9ca tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:40.037637 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-47b409c2-858d-409f-82af-d31bb341f9ca tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:40.038340 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-47b409c2-858d-409f-82af-d31bb341f9ca tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:40.063219 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG dbcounter [-] [118727] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:22:40.694169 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-87e19d5c-fd7d-498c-bb4d-62400e3acf05 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:22:40.695341 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-87e19d5c-fd7d-498c-bb4d-62400e3acf05 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 7a47cd33-e4a0-4b78-9afc-2f371e4a9d10] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:22:40.720114 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-87e19d5c-fd7d-498c-bb4d-62400e3acf05 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:40.722354 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-87e19d5c-fd7d-498c-bb4d-62400e3acf05 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:40.723246 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-87e19d5c-fd7d-498c-bb4d-62400e3acf05 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:40.727844 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-87e19d5c-fd7d-498c-bb4d-62400e3acf05 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:40.728407 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-87e19d5c-fd7d-498c-bb4d-62400e3acf05 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:40.735716 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-87e19d5c-fd7d-498c-bb4d-62400e3acf05 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:40.911369 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-47b409c2-858d-409f-82af-d31bb341f9ca tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:22:40.930730 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-47b409c2-858d-409f-82af-d31bb341f9ca tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:22:40.941268 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-47b409c2-858d-409f-82af-d31bb341f9ca tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:22:40.942659 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-47b409c2-858d-409f-82af-d31bb341f9ca tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa" status: 200 len: 1724 microversion: 2.20 time: 0.947117 Oct 31 19:22:40.943269 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 128/252] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 31 19:22:39 2022] GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa => generated 1724 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 19:22:41.394508 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-87e19d5c-fd7d-498c-bb4d-62400e3acf05 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc49f9eb3114759b2889ed8972136d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cf63c76fc543428404002ae9a75b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:22:41.417560 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-87e19d5c-fd7d-498c-bb4d-62400e3acf05 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/7a47cd33-e4a0-4b78-9afc-2f371e4a9d10" status: 200 len: 1520 microversion: 2.1 time: 0.726727 Oct 31 19:22:41.420160 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 125/253] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:22:40 2022] GET /compute/v2.1/servers/7a47cd33-e4a0-4b78-9afc-2f371e4a9d10 => generated 1520 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 19:22:41.984954 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-3228fac2-fb07-4130-9569-9eb2ede2f133 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:22:41.985697 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-3228fac2-fb07-4130-9569-9eb2ede2f133 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 24ad6e3e-6043-4eff-afb4-0c6039e825fa] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:22:42.001577 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-3228fac2-fb07-4130-9569-9eb2ede2f133 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:42.003270 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-3228fac2-fb07-4130-9569-9eb2ede2f133 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:42.005766 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-3228fac2-fb07-4130-9569-9eb2ede2f133 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:42.021519 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-3228fac2-fb07-4130-9569-9eb2ede2f133 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:42.022461 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-3228fac2-fb07-4130-9569-9eb2ede2f133 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:42.025126 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-3228fac2-fb07-4130-9569-9eb2ede2f133 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:42.448103 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-474d6951-ba27-4911-8633-54631882f83d tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:22:42.448718 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-474d6951-ba27-4911-8633-54631882f83d tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 7a47cd33-e4a0-4b78-9afc-2f371e4a9d10] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:22:42.459372 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-474d6951-ba27-4911-8633-54631882f83d tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:42.462763 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-474d6951-ba27-4911-8633-54631882f83d tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:42.463489 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-474d6951-ba27-4911-8633-54631882f83d tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:42.465057 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-474d6951-ba27-4911-8633-54631882f83d tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:42.468390 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-474d6951-ba27-4911-8633-54631882f83d tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:42.471432 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-474d6951-ba27-4911-8633-54631882f83d tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:42.699745 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-3228fac2-fb07-4130-9569-9eb2ede2f133 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:22:42.739896 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-3228fac2-fb07-4130-9569-9eb2ede2f133 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:22:42.748392 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-3228fac2-fb07-4130-9569-9eb2ede2f133 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:22:42.752362 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-3228fac2-fb07-4130-9569-9eb2ede2f133 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa" status: 200 len: 1724 microversion: 2.20 time: 0.780402 Oct 31 19:22:42.753757 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 129/254] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 31 19:22:41 2022] GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa => generated 1724 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 19:22:42.789287 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-474d6951-ba27-4911-8633-54631882f83d tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc49f9eb3114759b2889ed8972136d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cf63c76fc543428404002ae9a75b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:22:42.810284 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-474d6951-ba27-4911-8633-54631882f83d tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/7a47cd33-e4a0-4b78-9afc-2f371e4a9d10" status: 200 len: 1500 microversion: 2.1 time: 0.365020 Oct 31 19:22:42.812087 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 126/255] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:22:42 2022] GET /compute/v2.1/servers/7a47cd33-e4a0-4b78-9afc-2f371e4a9d10 => generated 1500 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:22:42.840976 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-2de9009d-ab43-46d3-97be-610eb4a8858c tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "70f95e39-9278-4d50-8299-a8f0063b8493"}} {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:22:42.843722 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-2de9009d-ab43-46d3-97be-610eb4a8858c tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 7a47cd33-e4a0-4b78-9afc-2f371e4a9d10] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:22:42.854335 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-2de9009d-ab43-46d3-97be-610eb4a8858c tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:42.855679 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-2de9009d-ab43-46d3-97be-610eb4a8858c tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:42.856327 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-2de9009d-ab43-46d3-97be-610eb4a8858c tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:42.859184 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-2de9009d-ab43-46d3-97be-610eb4a8858c tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:42.867824 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-2de9009d-ab43-46d3-97be-610eb4a8858c tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:42.868423 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-2de9009d-ab43-46d3-97be-610eb4a8858c tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:42.927520 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.wsgi [None req-2de9009d-ab43-46d3-97be-610eb4a8858c tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] HTTP exception thrown: Cannot 'attach_volume' instance 7a47cd33-e4a0-4b78-9afc-2f371e4a9d10 while it is in vm_state rescued Oct 31 19:22:42.929038 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-2de9009d-ab43-46d3-97be-610eb4a8858c tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Request method failure captured: Oct 31 19:22:42.929038 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: request: POST /compute/v2.1/servers/7a47cd33-e4a0-4b78-9afc-2f371e4a9d10/os-volume_attachments HTTP/1.1 Oct 31 19:22:42.929038 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Accept: application/json Oct 31 19:22:42.929038 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Accept-Encoding: identity Oct 31 19:22:42.929038 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Connection: close Oct 31 19:22:42.929038 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Content-Length: 74 Oct 31 19:22:42.929038 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Content-Type: application/json Oct 31 19:22:42.929038 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Host: 10.222.0.16 Oct 31 19:22:42.929038 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Openstack-System-Scope: None Oct 31 19:22:42.929038 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: User-Agent: python-urllib3/1.26.12 Oct 31 19:22:42.929038 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Auth-Token: gAAAAABjYCAUQ8YIOE1LqUgdd-VNJVSMmtJLqLbK8GSGQuylkQibi1W0G15Xlmc42Ab2ILvZHAFaOwUXTuxHL77kGeaOPHnfv7wa7hvLMGAh1mz7JFprCgygCLONv8fHZR7cWDh7VdBpvVSZYSPSFRHB1FTdSs8ZWKVZbGgsG6vqf9BFw1oXMP8 Oct 31 19:22:42.929038 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Domain-Id: None Oct 31 19:22:42.929038 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Domain-Name: None Oct 31 19:22:42.929038 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Identity-Status: Confirmed Oct 31 19:22:42.929038 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Is-Admin-Project: True Oct 31 19:22:42.929038 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Project-Domain-Id: default Oct 31 19:22:42.929038 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Project-Domain-Name: Default Oct 31 19:22:42.929038 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Project-Id: 73cf63c76fc543428404002ae9a75b29 Oct 31 19:22:42.929038 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-466281787 Oct 31 19:22:42.929038 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Role: member,reader Oct 31 19:22:42.929038 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Roles: member,reader Oct 31 19:22:42.930315 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/73cf63c76fc543428404002ae9a75b29"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_73cf63c76fc543428404002ae9a75b29", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/73cf63c76fc543428404002ae9a75b29"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/73cf63c76fc543428404002ae9a75b29"}]}] Oct 31 19:22:42.930315 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Tenant: tempest-ServerRescueNegativeTestJSON-466281787 Oct 31 19:22:42.930315 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Tenant-Id: 73cf63c76fc543428404002ae9a75b29 Oct 31 19:22:42.930315 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-466281787 Oct 31 19:22:42.930315 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User: tempest-ServerRescueNegativeTestJSON-466281787-project Oct 31 19:22:42.930315 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User-Domain-Id: default Oct 31 19:22:42.930315 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User-Domain-Name: Default Oct 31 19:22:42.930315 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User-Id: ddc49f9eb3114759b2889ed8972136d8 Oct 31 19:22:42.930315 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User-Name: tempest-ServerRescueNegativeTestJSON-466281787-project Oct 31 19:22:42.930315 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Oct 31 19:22:42.930315 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: {"volumeAttachment": {"volumeId": "70f95e39-9278-4d50-8299-a8f0063b8493"}} Oct 31 19:22:42.930315 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: method: > Oct 31 19:22:42.930993 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: exception: Cannot 'attach_volume' instance 7a47cd33-e4a0-4b78-9afc-2f371e4a9d10 while it is in vm_state rescued Oct 31 19:22:42.930993 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: action_args: {'server_id': '7a47cd33-e4a0-4b78-9afc-2f371e4a9d10', 'body': {'volumeAttachment': {'volumeId': '70f95e39-9278-4d50-8299-a8f0063b8493'}}} Oct 31 19:22:42.930993 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 19:22:42.930993 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:22:42.930993 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 31 19:22:42.930993 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 31 19:22:42.930993 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 31 19:22:42.930993 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 31 19:22:42.930993 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 31 19:22:42.930993 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 31 19:22:42.930993 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 7a47cd33-e4a0-4b78-9afc-2f371e4a9d10 in vm_state rescued. Cannot attach_volume while the instance is in this state. Oct 31 19:22:42.930993 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:22:42.930993 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 19:22:42.930993 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:22:42.930993 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:22:42.930993 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 19:22:42.930993 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 19:22:42.930993 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 19:22:42.930993 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 19:22:42.932028 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 19:22:42.932028 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 19:22:42.932028 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 19:22:42.932028 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 19:22:42.932028 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 19:22:42.932028 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 19:22:42.932028 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 19:22:42.932028 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 19:22:42.932028 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Oct 31 19:22:42.932028 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 31 19:22:42.932028 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 31 19:22:42.932028 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 31 19:22:42.932028 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 7a47cd33-e4a0-4b78-9afc-2f371e4a9d10 while it is in vm_state rescued Oct 31 19:22:42.932028 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:22:42.932028 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 19:22:42.932028 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:22:42.932028 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:22:42.932028 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 19:22:42.932028 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 19:22:42.933169 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 19:22:42.933169 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 19:22:42.933169 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 7a47cd33-e4a0-4b78-9afc-2f371e4a9d10 while it is in vm_state rescued Oct 31 19:22:42.933169 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:22:42.933169 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-2de9009d-ab43-46d3-97be-610eb4a8858c tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Returning 409 to user: Cannot 'attach_volume' instance 7a47cd33-e4a0-4b78-9afc-2f371e4a9d10 while it is in vm_state rescued {{(pid=118727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 19:22:42.933169 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-2de9009d-ab43-46d3-97be-610eb4a8858c tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "POST /compute/v2.1/servers/7a47cd33-e4a0-4b78-9afc-2f371e4a9d10/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.096291 Oct 31 19:22:42.942538 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 130/256] 10.222.0.16 () {60 vars in 1323 bytes} [Mon Oct 31 19:22:42 2022] POST /compute/v2.1/servers/7a47cd33-e4a0-4b78-9afc-2f371e4a9d10/os-volume_attachments => generated 152 bytes in 109 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 31 19:22:42.951006 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-ed579e47-3aa8-4ad6-87b3-207cf908c371 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:22:42.956171 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-ed579e47-3aa8-4ad6-87b3-207cf908c371 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 7a47cd33-e4a0-4b78-9afc-2f371e4a9d10] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:22:42.973500 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-ed579e47-3aa8-4ad6-87b3-207cf908c371 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:42.974494 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-ed579e47-3aa8-4ad6-87b3-207cf908c371 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:42.975973 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-ed579e47-3aa8-4ad6-87b3-207cf908c371 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:42.978262 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-ed579e47-3aa8-4ad6-87b3-207cf908c371 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:42.980626 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-ed579e47-3aa8-4ad6-87b3-207cf908c371 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:42.981370 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-ed579e47-3aa8-4ad6-87b3-207cf908c371 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:43.139395 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-ed579e47-3aa8-4ad6-87b3-207cf908c371 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "POST /compute/v2.1/servers/7a47cd33-e4a0-4b78-9afc-2f371e4a9d10/action" status: 202 len: 0 microversion: 2.1 time: 0.192030 Oct 31 19:22:43.143201 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 127/257] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 31 19:22:42 2022] POST /compute/v2.1/servers/7a47cd33-e4a0-4b78-9afc-2f371e4a9d10/action => generated 0 bytes in 197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 19:22:43.151283 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-63d88f33-4a12-46d3-adf5-78ec9f4b61f9 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:22:43.152205 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-63d88f33-4a12-46d3-adf5-78ec9f4b61f9 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 7a47cd33-e4a0-4b78-9afc-2f371e4a9d10] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:22:43.177760 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-63d88f33-4a12-46d3-adf5-78ec9f4b61f9 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:43.178182 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-63d88f33-4a12-46d3-adf5-78ec9f4b61f9 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:43.178810 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-63d88f33-4a12-46d3-adf5-78ec9f4b61f9 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:43.183191 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-63d88f33-4a12-46d3-adf5-78ec9f4b61f9 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:43.183928 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-63d88f33-4a12-46d3-adf5-78ec9f4b61f9 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:43.184566 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-63d88f33-4a12-46d3-adf5-78ec9f4b61f9 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:43.754504 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-63d88f33-4a12-46d3-adf5-78ec9f4b61f9 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc49f9eb3114759b2889ed8972136d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cf63c76fc543428404002ae9a75b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:22:43.765901 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-63d88f33-4a12-46d3-adf5-78ec9f4b61f9 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/7a47cd33-e4a0-4b78-9afc-2f371e4a9d10" status: 200 len: 1508 microversion: 2.1 time: 0.618620 Oct 31 19:22:43.766604 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 131/258] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:22:43 2022] GET /compute/v2.1/servers/7a47cd33-e4a0-4b78-9afc-2f371e4a9d10 => generated 1508 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 19:22:43.787383 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-66b94a1d-3f71-42be-93df-edce472ecc32 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:22:43.788770 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-66b94a1d-3f71-42be-93df-edce472ecc32 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 24ad6e3e-6043-4eff-afb4-0c6039e825fa] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:22:43.811614 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-66b94a1d-3f71-42be-93df-edce472ecc32 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:43.817864 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-66b94a1d-3f71-42be-93df-edce472ecc32 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:43.818585 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-66b94a1d-3f71-42be-93df-edce472ecc32 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:43.819961 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-66b94a1d-3f71-42be-93df-edce472ecc32 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:43.820617 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-66b94a1d-3f71-42be-93df-edce472ecc32 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:43.822710 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-66b94a1d-3f71-42be-93df-edce472ecc32 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:44.492971 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-66b94a1d-3f71-42be-93df-edce472ecc32 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:22:44.512482 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-66b94a1d-3f71-42be-93df-edce472ecc32 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:22:44.520092 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-66b94a1d-3f71-42be-93df-edce472ecc32 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:22:44.521329 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-66b94a1d-3f71-42be-93df-edce472ecc32 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa" status: 200 len: 1724 microversion: 2.20 time: 0.741554 Oct 31 19:22:44.524760 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 128/259] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 31 19:22:43 2022] GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa => generated 1724 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 19:22:44.796778 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-6edde2cd-1b47-4e8e-b263-e9590dcecd4c tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:22:44.805248 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-6edde2cd-1b47-4e8e-b263-e9590dcecd4c tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 7a47cd33-e4a0-4b78-9afc-2f371e4a9d10] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:22:44.820967 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-6edde2cd-1b47-4e8e-b263-e9590dcecd4c tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:44.821936 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-6edde2cd-1b47-4e8e-b263-e9590dcecd4c tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:44.822551 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-6edde2cd-1b47-4e8e-b263-e9590dcecd4c tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:44.827416 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-6edde2cd-1b47-4e8e-b263-e9590dcecd4c tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:44.828142 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-6edde2cd-1b47-4e8e-b263-e9590dcecd4c tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:44.831373 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-6edde2cd-1b47-4e8e-b263-e9590dcecd4c tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:45.119334 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-6edde2cd-1b47-4e8e-b263-e9590dcecd4c tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc49f9eb3114759b2889ed8972136d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cf63c76fc543428404002ae9a75b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:22:45.131798 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-6edde2cd-1b47-4e8e-b263-e9590dcecd4c tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/7a47cd33-e4a0-4b78-9afc-2f371e4a9d10" status: 200 len: 1508 microversion: 2.1 time: 0.338788 Oct 31 19:22:45.134513 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 132/260] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:22:44 2022] GET /compute/v2.1/servers/7a47cd33-e4a0-4b78-9afc-2f371e4a9d10 => generated 1508 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:22:45.551421 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-1a54cc7e-0f0d-46c2-a752-43c42442722a tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:22:45.552172 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-1a54cc7e-0f0d-46c2-a752-43c42442722a tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 24ad6e3e-6043-4eff-afb4-0c6039e825fa] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:22:45.572808 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-1a54cc7e-0f0d-46c2-a752-43c42442722a tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:45.573299 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-1a54cc7e-0f0d-46c2-a752-43c42442722a tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:45.574019 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-1a54cc7e-0f0d-46c2-a752-43c42442722a tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:45.574727 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-1a54cc7e-0f0d-46c2-a752-43c42442722a tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:45.577835 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-1a54cc7e-0f0d-46c2-a752-43c42442722a tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:45.578612 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-1a54cc7e-0f0d-46c2-a752-43c42442722a tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:45.900133 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-1a54cc7e-0f0d-46c2-a752-43c42442722a tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:22:45.914881 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-1a54cc7e-0f0d-46c2-a752-43c42442722a tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:22:45.917356 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-1a54cc7e-0f0d-46c2-a752-43c42442722a tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:22:45.918226 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-1a54cc7e-0f0d-46c2-a752-43c42442722a tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa" status: 200 len: 1724 microversion: 2.20 time: 0.371461 Oct 31 19:22:45.923339 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 129/261] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 31 19:22:45 2022] GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa => generated 1724 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 19:22:46.160925 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-0bb6105b-db79-4cad-a857-7a9d4891abcb tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:22:46.162766 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-0bb6105b-db79-4cad-a857-7a9d4891abcb tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 7a47cd33-e4a0-4b78-9afc-2f371e4a9d10] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:22:46.177425 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-0bb6105b-db79-4cad-a857-7a9d4891abcb tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:46.177969 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-0bb6105b-db79-4cad-a857-7a9d4891abcb tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:46.188332 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-0bb6105b-db79-4cad-a857-7a9d4891abcb tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:46.198041 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-0bb6105b-db79-4cad-a857-7a9d4891abcb tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:46.198796 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-0bb6105b-db79-4cad-a857-7a9d4891abcb tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:46.199585 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-0bb6105b-db79-4cad-a857-7a9d4891abcb tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:46.506337 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-f59e4e58-7b1c-4486-8f47-51295938cfa3 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:22:46.508389 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-f59e4e58-7b1c-4486-8f47-51295938cfa3 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] [instance: 0a122a08-bc0f-40fd-8139-74c9e8a70ebe] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:22:46.522569 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-f59e4e58-7b1c-4486-8f47-51295938cfa3 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:46.523197 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-f59e4e58-7b1c-4486-8f47-51295938cfa3 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:46.523625 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-f59e4e58-7b1c-4486-8f47-51295938cfa3 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:46.530309 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-f59e4e58-7b1c-4486-8f47-51295938cfa3 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:46.533155 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-f59e4e58-7b1c-4486-8f47-51295938cfa3 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:46.536830 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-f59e4e58-7b1c-4486-8f47-51295938cfa3 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:46.604713 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-f59e4e58-7b1c-4486-8f47-51295938cfa3 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] 10.222.0.16 "GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe/ips" status: 200 len: 144 microversion: 2.1 time: 0.103102 Oct 31 19:22:46.613760 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 130/262] 10.222.0.16 () {58 vars in 1248 bytes} [Mon Oct 31 19:22:46 2022] GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe/ips => generated 144 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 19:22:46.959288 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-4d6e2590-391d-4b0b-a751-1427dbb506a0 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:22:46.960294 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-4d6e2590-391d-4b0b-a751-1427dbb506a0 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 24ad6e3e-6043-4eff-afb4-0c6039e825fa] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:22:46.971131 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-4d6e2590-391d-4b0b-a751-1427dbb506a0 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:46.973442 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-4d6e2590-391d-4b0b-a751-1427dbb506a0 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:46.994062 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-4d6e2590-391d-4b0b-a751-1427dbb506a0 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:46.996575 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-4d6e2590-391d-4b0b-a751-1427dbb506a0 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:46.997530 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-4d6e2590-391d-4b0b-a751-1427dbb506a0 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:46.998409 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-4d6e2590-391d-4b0b-a751-1427dbb506a0 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:47.238777 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-0bb6105b-db79-4cad-a857-7a9d4891abcb tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc49f9eb3114759b2889ed8972136d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cf63c76fc543428404002ae9a75b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:22:47.247466 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-0bb6105b-db79-4cad-a857-7a9d4891abcb tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/7a47cd33-e4a0-4b78-9afc-2f371e4a9d10" status: 200 len: 1508 microversion: 2.1 time: 1.090757 Oct 31 19:22:47.249980 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 133/263] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:22:46 2022] GET /compute/v2.1/servers/7a47cd33-e4a0-4b78-9afc-2f371e4a9d10 => generated 1508 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:22:47.676950 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-4d6e2590-391d-4b0b-a751-1427dbb506a0 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:22:47.698778 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-4d6e2590-391d-4b0b-a751-1427dbb506a0 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:22:47.701055 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-4d6e2590-391d-4b0b-a751-1427dbb506a0 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:22:47.703217 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-4d6e2590-391d-4b0b-a751-1427dbb506a0 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa" status: 200 len: 1724 microversion: 2.20 time: 0.753887 Oct 31 19:22:47.706697 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 131/264] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 31 19:22:46 2022] GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa => generated 1724 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 19:22:48.277309 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-ac6ad292-63e3-424d-8058-dc66c0fa9738 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:22:48.278114 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-ac6ad292-63e3-424d-8058-dc66c0fa9738 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 7a47cd33-e4a0-4b78-9afc-2f371e4a9d10] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:22:48.286748 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-ac6ad292-63e3-424d-8058-dc66c0fa9738 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:48.288917 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-ac6ad292-63e3-424d-8058-dc66c0fa9738 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:48.289385 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-ac6ad292-63e3-424d-8058-dc66c0fa9738 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:48.290936 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-ac6ad292-63e3-424d-8058-dc66c0fa9738 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:48.291494 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-ac6ad292-63e3-424d-8058-dc66c0fa9738 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:48.295101 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-ac6ad292-63e3-424d-8058-dc66c0fa9738 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:48.688917 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-ac6ad292-63e3-424d-8058-dc66c0fa9738 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc49f9eb3114759b2889ed8972136d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cf63c76fc543428404002ae9a75b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:22:48.697018 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-ac6ad292-63e3-424d-8058-dc66c0fa9738 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/7a47cd33-e4a0-4b78-9afc-2f371e4a9d10" status: 200 len: 1508 microversion: 2.1 time: 0.423906 Oct 31 19:22:48.707628 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 134/265] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:22:48 2022] GET /compute/v2.1/servers/7a47cd33-e4a0-4b78-9afc-2f371e4a9d10 => generated 1508 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:22:48.734643 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-8ab4da41-6c2c-44f2-bacf-b9c9babacb05 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:22:48.735260 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-8ab4da41-6c2c-44f2-bacf-b9c9babacb05 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 24ad6e3e-6043-4eff-afb4-0c6039e825fa] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:22:48.747758 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG dbcounter [-] [118726] Writing DB stats nova_cell0:SELECT=4 {{(pid=118726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:22:48.751212 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-8ab4da41-6c2c-44f2-bacf-b9c9babacb05 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:48.751739 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-8ab4da41-6c2c-44f2-bacf-b9c9babacb05 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:48.752232 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-8ab4da41-6c2c-44f2-bacf-b9c9babacb05 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:48.755043 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-8ab4da41-6c2c-44f2-bacf-b9c9babacb05 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:48.755518 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-8ab4da41-6c2c-44f2-bacf-b9c9babacb05 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:48.755953 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-8ab4da41-6c2c-44f2-bacf-b9c9babacb05 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:49.099619 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-8ab4da41-6c2c-44f2-bacf-b9c9babacb05 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:22:49.110207 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-8ab4da41-6c2c-44f2-bacf-b9c9babacb05 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:22:49.119062 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-8ab4da41-6c2c-44f2-bacf-b9c9babacb05 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:22:49.120474 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-8ab4da41-6c2c-44f2-bacf-b9c9babacb05 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa" status: 200 len: 1724 microversion: 2.20 time: 0.390191 Oct 31 19:22:49.121845 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 132/266] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 31 19:22:48 2022] GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa => generated 1724 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 19:22:49.755268 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-3d5a1546-a6ff-45ad-b9ee-aeeb3c2c6571 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:22:49.756853 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-3d5a1546-a6ff-45ad-b9ee-aeeb3c2c6571 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 7a47cd33-e4a0-4b78-9afc-2f371e4a9d10] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:22:49.764433 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-3d5a1546-a6ff-45ad-b9ee-aeeb3c2c6571 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:49.765155 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-3d5a1546-a6ff-45ad-b9ee-aeeb3c2c6571 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:49.765874 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-3d5a1546-a6ff-45ad-b9ee-aeeb3c2c6571 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:49.766971 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-3d5a1546-a6ff-45ad-b9ee-aeeb3c2c6571 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:49.767822 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-3d5a1546-a6ff-45ad-b9ee-aeeb3c2c6571 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:49.768610 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-3d5a1546-a6ff-45ad-b9ee-aeeb3c2c6571 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:50.156070 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-c15f94bf-4667-49ff-a1af-a422681617a8 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:22:50.158938 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-c15f94bf-4667-49ff-a1af-a422681617a8 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 24ad6e3e-6043-4eff-afb4-0c6039e825fa] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:22:50.180619 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-c15f94bf-4667-49ff-a1af-a422681617a8 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:50.187398 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-c15f94bf-4667-49ff-a1af-a422681617a8 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:50.188168 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-c15f94bf-4667-49ff-a1af-a422681617a8 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:50.195239 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-c15f94bf-4667-49ff-a1af-a422681617a8 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:50.200710 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-c15f94bf-4667-49ff-a1af-a422681617a8 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:50.211139 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-c15f94bf-4667-49ff-a1af-a422681617a8 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:50.606497 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-c15f94bf-4667-49ff-a1af-a422681617a8 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:22:50.617595 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-c15f94bf-4667-49ff-a1af-a422681617a8 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:22:50.619836 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-c15f94bf-4667-49ff-a1af-a422681617a8 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:22:50.621815 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-c15f94bf-4667-49ff-a1af-a422681617a8 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa" status: 200 len: 1724 microversion: 2.20 time: 0.475237 Oct 31 19:22:50.622994 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 133/267] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 31 19:22:50 2022] GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa => generated 1724 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 19:22:50.656973 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-3d5a1546-a6ff-45ad-b9ee-aeeb3c2c6571 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc49f9eb3114759b2889ed8972136d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cf63c76fc543428404002ae9a75b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:22:50.669332 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-3d5a1546-a6ff-45ad-b9ee-aeeb3c2c6571 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/7a47cd33-e4a0-4b78-9afc-2f371e4a9d10" status: 200 len: 1508 microversion: 2.1 time: 0.932781 Oct 31 19:22:50.670231 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 135/268] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:22:49 2022] GET /compute/v2.1/servers/7a47cd33-e4a0-4b78-9afc-2f371e4a9d10 => generated 1508 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:22:51.653056 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-0b60ef80-e5bd-437f-a389-55524c85ca91 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:22:51.653720 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-0b60ef80-e5bd-437f-a389-55524c85ca91 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 24ad6e3e-6043-4eff-afb4-0c6039e825fa] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:22:51.682742 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG dbcounter [-] [118726] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=1 {{(pid=118726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:22:51.698114 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-92448135-de3e-4a30-90e9-99a3f57b737f tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:22:51.699444 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-92448135-de3e-4a30-90e9-99a3f57b737f tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 7a47cd33-e4a0-4b78-9afc-2f371e4a9d10] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:22:51.707342 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-0b60ef80-e5bd-437f-a389-55524c85ca91 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:51.708270 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-0b60ef80-e5bd-437f-a389-55524c85ca91 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:51.710143 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-92448135-de3e-4a30-90e9-99a3f57b737f tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:51.710844 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-0b60ef80-e5bd-437f-a389-55524c85ca91 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:51.714348 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-0b60ef80-e5bd-437f-a389-55524c85ca91 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:51.715380 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-92448135-de3e-4a30-90e9-99a3f57b737f tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:51.716135 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-0b60ef80-e5bd-437f-a389-55524c85ca91 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:51.716785 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-0b60ef80-e5bd-437f-a389-55524c85ca91 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:51.717695 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-92448135-de3e-4a30-90e9-99a3f57b737f tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:51.719627 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-92448135-de3e-4a30-90e9-99a3f57b737f tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:51.721194 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-92448135-de3e-4a30-90e9-99a3f57b737f tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:51.722131 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-92448135-de3e-4a30-90e9-99a3f57b737f tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:51.774996 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG dbcounter [-] [118726] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:22:52.133580 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-0b60ef80-e5bd-437f-a389-55524c85ca91 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:22:52.154544 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-0b60ef80-e5bd-437f-a389-55524c85ca91 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:22:52.159838 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-0b60ef80-e5bd-437f-a389-55524c85ca91 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:22:52.175918 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-0b60ef80-e5bd-437f-a389-55524c85ca91 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa" status: 200 len: 1724 microversion: 2.20 time: 0.529424 Oct 31 19:22:52.178637 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 134/269] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 31 19:22:51 2022] GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa => generated 1724 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 19:22:52.206589 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-92448135-de3e-4a30-90e9-99a3f57b737f tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc49f9eb3114759b2889ed8972136d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cf63c76fc543428404002ae9a75b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:22:52.220840 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-92448135-de3e-4a30-90e9-99a3f57b737f tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/7a47cd33-e4a0-4b78-9afc-2f371e4a9d10" status: 200 len: 1508 microversion: 2.1 time: 0.522010 Oct 31 19:22:52.249598 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 136/270] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:22:51 2022] GET /compute/v2.1/servers/7a47cd33-e4a0-4b78-9afc-2f371e4a9d10 => generated 1508 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:22:53.212530 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-6c100d71-1660-4c21-b10c-c3949f179011 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:22:53.215066 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-6c100d71-1660-4c21-b10c-c3949f179011 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 24ad6e3e-6043-4eff-afb4-0c6039e825fa] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:22:53.231161 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-6c100d71-1660-4c21-b10c-c3949f179011 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:53.235272 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-6c100d71-1660-4c21-b10c-c3949f179011 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:53.242916 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-6c100d71-1660-4c21-b10c-c3949f179011 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:53.245121 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-6c100d71-1660-4c21-b10c-c3949f179011 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:53.245938 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-6c100d71-1660-4c21-b10c-c3949f179011 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:53.246583 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-6c100d71-1660-4c21-b10c-c3949f179011 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:53.280921 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-6f50ea85-836a-4f5e-978c-be8c6bbc5f1a tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:22:53.282206 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-6f50ea85-836a-4f5e-978c-be8c6bbc5f1a tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 7a47cd33-e4a0-4b78-9afc-2f371e4a9d10] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:22:53.292190 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-6f50ea85-836a-4f5e-978c-be8c6bbc5f1a tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:53.296845 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-6f50ea85-836a-4f5e-978c-be8c6bbc5f1a tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:53.297648 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-6f50ea85-836a-4f5e-978c-be8c6bbc5f1a tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:53.299290 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-6f50ea85-836a-4f5e-978c-be8c6bbc5f1a tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:53.304313 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-6f50ea85-836a-4f5e-978c-be8c6bbc5f1a tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:53.304760 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-6f50ea85-836a-4f5e-978c-be8c6bbc5f1a tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:54.196279 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-6f50ea85-836a-4f5e-978c-be8c6bbc5f1a tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc49f9eb3114759b2889ed8972136d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cf63c76fc543428404002ae9a75b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:22:54.220241 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-6f50ea85-836a-4f5e-978c-be8c6bbc5f1a tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/7a47cd33-e4a0-4b78-9afc-2f371e4a9d10" status: 200 len: 1508 microversion: 2.1 time: 0.954290 Oct 31 19:22:54.245919 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 137/271] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:22:53 2022] GET /compute/v2.1/servers/7a47cd33-e4a0-4b78-9afc-2f371e4a9d10 => generated 1508 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:22:54.265065 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-d1797161-6609-4e91-8dd2-0d2e2ae072c9 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "da95725e-e3cf-40c8-8bce-8fe11a45eb4e"}} {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:22:54.280893 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-d1797161-6609-4e91-8dd2-0d2e2ae072c9 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] [instance: 0a122a08-bc0f-40fd-8139-74c9e8a70ebe] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:22:54.315770 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-d1797161-6609-4e91-8dd2-0d2e2ae072c9 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:54.316439 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-d1797161-6609-4e91-8dd2-0d2e2ae072c9 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:54.316709 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-d1797161-6609-4e91-8dd2-0d2e2ae072c9 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:54.317427 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-d1797161-6609-4e91-8dd2-0d2e2ae072c9 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:54.325767 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-d1797161-6609-4e91-8dd2-0d2e2ae072c9 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:54.326683 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-d1797161-6609-4e91-8dd2-0d2e2ae072c9 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:54.786701 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-6c100d71-1660-4c21-b10c-c3949f179011 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:22:54.837402 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-6c100d71-1660-4c21-b10c-c3949f179011 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:22:54.845352 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-6c100d71-1660-4c21-b10c-c3949f179011 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:22:54.849797 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-6c100d71-1660-4c21-b10c-c3949f179011 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa" status: 200 len: 1724 microversion: 2.20 time: 1.641237 Oct 31 19:22:54.862553 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 135/272] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 31 19:22:53 2022] GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa => generated 1724 bytes in 1654 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 19:22:55.087934 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-d1797161-6609-4e91-8dd2-0d2e2ae072c9 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] 10.222.0.16 "POST /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.837973 Oct 31 19:22:55.090397 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 138/273] 10.222.0.16 () {60 vars in 1323 bytes} [Mon Oct 31 19:22:54 2022] POST /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe/os-volume_attachments => generated 194 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:22:55.258440 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-722a7b24-5584-446f-804f-aa68c791d21a tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:22:55.259894 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-722a7b24-5584-446f-804f-aa68c791d21a tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 7a47cd33-e4a0-4b78-9afc-2f371e4a9d10] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:22:55.275644 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-722a7b24-5584-446f-804f-aa68c791d21a tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:55.278326 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-722a7b24-5584-446f-804f-aa68c791d21a tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:55.279289 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-722a7b24-5584-446f-804f-aa68c791d21a tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:55.282398 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-722a7b24-5584-446f-804f-aa68c791d21a tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:55.285234 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-722a7b24-5584-446f-804f-aa68c791d21a tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:55.285781 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-722a7b24-5584-446f-804f-aa68c791d21a tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:55.878159 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-a6b42580-9213-4aaf-834f-0abbbd3aefef tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:22:55.878973 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-a6b42580-9213-4aaf-834f-0abbbd3aefef tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 24ad6e3e-6043-4eff-afb4-0c6039e825fa] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:22:55.905406 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-a6b42580-9213-4aaf-834f-0abbbd3aefef tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:55.906323 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-a6b42580-9213-4aaf-834f-0abbbd3aefef tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:55.910461 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-a6b42580-9213-4aaf-834f-0abbbd3aefef tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:55.930160 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-a6b42580-9213-4aaf-834f-0abbbd3aefef tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:55.934132 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-a6b42580-9213-4aaf-834f-0abbbd3aefef tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:55.936271 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-a6b42580-9213-4aaf-834f-0abbbd3aefef tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:56.112617 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-722a7b24-5584-446f-804f-aa68c791d21a tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc49f9eb3114759b2889ed8972136d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cf63c76fc543428404002ae9a75b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:22:56.123366 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-722a7b24-5584-446f-804f-aa68c791d21a tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/7a47cd33-e4a0-4b78-9afc-2f371e4a9d10" status: 200 len: 1514 microversion: 2.1 time: 0.874186 Oct 31 19:22:56.124012 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 136/274] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:22:55 2022] GET /compute/v2.1/servers/7a47cd33-e4a0-4b78-9afc-2f371e4a9d10 => generated 1514 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:22:56.584304 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-a6b42580-9213-4aaf-834f-0abbbd3aefef tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:22:56.598857 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-a6b42580-9213-4aaf-834f-0abbbd3aefef tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:22:56.609583 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-a6b42580-9213-4aaf-834f-0abbbd3aefef tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:22:56.613331 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-a6b42580-9213-4aaf-834f-0abbbd3aefef tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa" status: 200 len: 1724 microversion: 2.20 time: 0.740688 Oct 31 19:22:56.617757 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 139/275] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 31 19:22:55 2022] GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa => generated 1724 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 19:22:57.642742 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-3cffc591-ea0d-403e-a53c-913b54305083 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:22:57.644099 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-3cffc591-ea0d-403e-a53c-913b54305083 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 24ad6e3e-6043-4eff-afb4-0c6039e825fa] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:22:57.653227 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-3cffc591-ea0d-403e-a53c-913b54305083 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:57.654177 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-3cffc591-ea0d-403e-a53c-913b54305083 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:57.654823 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-3cffc591-ea0d-403e-a53c-913b54305083 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:57.655747 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-3cffc591-ea0d-403e-a53c-913b54305083 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:57.656958 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-3cffc591-ea0d-403e-a53c-913b54305083 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:57.657771 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-3cffc591-ea0d-403e-a53c-913b54305083 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:57.996929 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-3cffc591-ea0d-403e-a53c-913b54305083 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:22:58.020327 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-3cffc591-ea0d-403e-a53c-913b54305083 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:22:58.025717 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-3cffc591-ea0d-403e-a53c-913b54305083 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:22:58.029955 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-3cffc591-ea0d-403e-a53c-913b54305083 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa" status: 200 len: 1724 microversion: 2.20 time: 0.390872 Oct 31 19:22:58.034348 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 137/276] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 31 19:22:57 2022] GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa => generated 1724 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 19:22:58.305502 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-92863c31-48fe-4a43-bd9e-e2f300738afc tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Action: 'create', calling method: .version_select at 0x7f34f2105ee0>, body: {"keypair": {"name": "tempest-keypair-1462207282", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBqZS0N6mRq9bGwZuQqglHHOwdT5Qj/PZuEKDuy3JfR4vvjK3RhY45D+i/XR+vaXLJRiwVMA5HzrlAEJy31HV1NauxCXXhqNvmmzDu46otPoLU3Zfr+EiA7XNWzwMukKIg=="}} {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:22:58.391245 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.quota [None req-92863c31-48fe-4a43-bd9e-e2f300738afc tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Getting quotas for project 73cf63c76fc543428404002ae9a75b29. Resources: {'key_pairs'} {{(pid=118727) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 19:22:58.411444 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.quota [None req-92863c31-48fe-4a43-bd9e-e2f300738afc tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Getting quotas for user ddc49f9eb3114759b2889ed8972136d8 and project 73cf63c76fc543428404002ae9a75b29. Resources: {'key_pairs'} {{(pid=118727) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 19:22:58.498220 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-92863c31-48fe-4a43-bd9e-e2f300738afc tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.215585 Oct 31 19:22:58.515286 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 140/277] 10.222.0.16 () {60 vars in 1159 bytes} [Mon Oct 31 19:22:58 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:22:58.881160 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-9375dc05-e541-4e0f-890b-7c96b6c4d9c8 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Action: 'create', calling method: .version_select at 0x7f34f22941f0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-298495679", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOAodjaF8/Wk2/siE/kIAUbeWuv1/w7b3cxlIQNXU8+Y+HBlwpdMPDsmPoXWJxwBd349N3GnOgObRsYRv01+t+Btm9PJC5Mma4UprItcJDaG8t4f+ISQUwVADsykCQC8qA=="}} {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:22:58.947137 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.quota [None req-9375dc05-e541-4e0f-890b-7c96b6c4d9c8 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Getting quotas for project 808cc3e5392b4bb7a80b154a60f69ee3. Resources: {'key_pairs'} {{(pid=118726) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 19:22:58.967714 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.quota [None req-9375dc05-e541-4e0f-890b-7c96b6c4d9c8 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Getting quotas for user 7e73a60801b04fc7acc4260297fdd2e4 and project 808cc3e5392b4bb7a80b154a60f69ee3. Resources: {'key_pairs'} {{(pid=118726) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 19:22:59.036673 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-9375dc05-e541-4e0f-890b-7c96b6c4d9c8 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.643295 Oct 31 19:22:59.044000 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 138/278] 10.222.0.16 () {60 vars in 1159 bytes} [Mon Oct 31 19:22:58 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 19:22:59.063373 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-be64cadd-40de-4d80-a4ba-fb3c58d546af tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:22:59.064527 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-be64cadd-40de-4d80-a4ba-fb3c58d546af tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 24ad6e3e-6043-4eff-afb4-0c6039e825fa] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:22:59.087636 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-be64cadd-40de-4d80-a4ba-fb3c58d546af tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:59.099307 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-be64cadd-40de-4d80-a4ba-fb3c58d546af tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:59.100147 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-be64cadd-40de-4d80-a4ba-fb3c58d546af tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:59.102772 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-be64cadd-40de-4d80-a4ba-fb3c58d546af tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:22:59.103430 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-be64cadd-40de-4d80-a4ba-fb3c58d546af tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:22:59.107208 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-be64cadd-40de-4d80-a4ba-fb3c58d546af tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:22:59.978674 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-be64cadd-40de-4d80-a4ba-fb3c58d546af tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:22:59.989584 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-be64cadd-40de-4d80-a4ba-fb3c58d546af tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:22:59.991380 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-be64cadd-40de-4d80-a4ba-fb3c58d546af tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:22:59.992855 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-be64cadd-40de-4d80-a4ba-fb3c58d546af tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa" status: 200 len: 1724 microversion: 2.20 time: 0.935863 Oct 31 19:23:00.006406 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 141/279] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 31 19:22:59 2022] GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa => generated 1724 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 19:23:01.029950 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-d66f2121-c48c-41ba-a90b-868ce7287525 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:23:01.033571 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-d66f2121-c48c-41ba-a90b-868ce7287525 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 24ad6e3e-6043-4eff-afb4-0c6039e825fa] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:23:01.060288 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-d66f2121-c48c-41ba-a90b-868ce7287525 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:01.066255 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-d66f2121-c48c-41ba-a90b-868ce7287525 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:01.068321 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-d66f2121-c48c-41ba-a90b-868ce7287525 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:01.071631 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-d66f2121-c48c-41ba-a90b-868ce7287525 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:01.074789 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-d66f2121-c48c-41ba-a90b-868ce7287525 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:01.075519 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-d66f2121-c48c-41ba-a90b-868ce7287525 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:01.509836 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-d66f2121-c48c-41ba-a90b-868ce7287525 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:01.522710 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-d66f2121-c48c-41ba-a90b-868ce7287525 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:01.528486 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-d66f2121-c48c-41ba-a90b-868ce7287525 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:01.539989 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-d66f2121-c48c-41ba-a90b-868ce7287525 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa" status: 200 len: 1724 microversion: 2.20 time: 0.517685 Oct 31 19:23:01.554377 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 139/280] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 31 19:23:01 2022] GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa => generated 1724 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 19:23:02.283699 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-d68b1a8d-7abb-496d-9e2b-3ecffe86f2d1 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:23:02.297355 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-d68b1a8d-7abb-496d-9e2b-3ecffe86f2d1 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:02.301270 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-d68b1a8d-7abb-496d-9e2b-3ecffe86f2d1 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:02.302678 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-d68b1a8d-7abb-496d-9e2b-3ecffe86f2d1 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:02.475940 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-d68b1a8d-7abb-496d-9e2b-3ecffe86f2d1 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] [instance: 0a122a08-bc0f-40fd-8139-74c9e8a70ebe] Going to try to stop instance {{(pid=118727) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 31 19:23:02.547307 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-79f0a6ce-ca49-4177-b1c4-7105e1c326ad tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1067416208", "imageRef": "a9795ee0-6722-4e1e-8fc8-a6c2e68f3049", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "76d0a169-b981-4155-bbd7-0bbdbbf23238"}], "security_groups": [{"name": "tempest-securitygroup--4246718"}], "key_name": "tempest-keypair-1462207282", "user_data": "}} {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:23:02.611712 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-d68b1a8d-7abb-496d-9e2b-3ecffe86f2d1 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] 10.222.0.16 "POST /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe/action" status: 202 len: 0 microversion: 2.1 time: 0.333231 Oct 31 19:23:02.612348 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 142/281] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 31 19:23:02 2022] POST /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe/action => generated 0 bytes in 335 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 19:23:02.641271 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-13f18d40-6b70-4c25-9c0a-b852b37bd14b tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:23:02.642627 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-13f18d40-6b70-4c25-9c0a-b852b37bd14b tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 24ad6e3e-6043-4eff-afb4-0c6039e825fa] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:23:02.664846 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-13f18d40-6b70-4c25-9c0a-b852b37bd14b tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:02.667197 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-13f18d40-6b70-4c25-9c0a-b852b37bd14b tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:02.667645 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-13f18d40-6b70-4c25-9c0a-b852b37bd14b tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:02.668384 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-13f18d40-6b70-4c25-9c0a-b852b37bd14b tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:02.670740 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-13f18d40-6b70-4c25-9c0a-b852b37bd14b tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:02.671197 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-13f18d40-6b70-4c25-9c0a-b852b37bd14b tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:02.955587 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.network.neutron [None req-79f0a6ce-ca49-4177-b1c4-7105e1c326ad tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] validate_networks() for [('76d0a169-b981-4155-bbd7-0bbdbbf23238', None, None, None, None, None)] {{(pid=118726) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 19:23:03.087763 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-13f18d40-6b70-4c25-9c0a-b852b37bd14b tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:03.097481 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-13f18d40-6b70-4c25-9c0a-b852b37bd14b tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:03.108131 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-13f18d40-6b70-4c25-9c0a-b852b37bd14b tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:03.115042 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-13f18d40-6b70-4c25-9c0a-b852b37bd14b tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa" status: 200 len: 1724 microversion: 2.20 time: 0.490833 Oct 31 19:23:03.119471 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 143/282] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 31 19:23:02 2022] GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa => generated 1724 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 19:23:03.143353 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-410750dd-7c9d-4ab9-b8c9-8ba7c1540e6e tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:23:03.144719 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-410750dd-7c9d-4ab9-b8c9-8ba7c1540e6e tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] [instance: 0a122a08-bc0f-40fd-8139-74c9e8a70ebe] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:23:03.155127 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-410750dd-7c9d-4ab9-b8c9-8ba7c1540e6e tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:03.155647 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-410750dd-7c9d-4ab9-b8c9-8ba7c1540e6e tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:03.156084 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-410750dd-7c9d-4ab9-b8c9-8ba7c1540e6e tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:03.156795 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-410750dd-7c9d-4ab9-b8c9-8ba7c1540e6e tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:03.157241 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-410750dd-7c9d-4ab9-b8c9-8ba7c1540e6e tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:03.159867 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-410750dd-7c9d-4ab9-b8c9-8ba7c1540e6e tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:03.165822 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG dbcounter [-] [118727] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:23:03.560215 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-410750dd-7c9d-4ab9-b8c9-8ba7c1540e6e tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ece6ca9374764214bac6263bd691bc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9c317b548b40deb8cb27236d36d674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:03.573208 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-410750dd-7c9d-4ab9-b8c9-8ba7c1540e6e tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] 10.222.0.16 "GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe" status: 200 len: 1721 microversion: 2.1 time: 0.442171 Oct 31 19:23:03.574843 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 144/283] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:23:03 2022] GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe => generated 1721 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:23:04.148414 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-6c10e609-3b9c-46c9-b29c-a0942e042337 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:23:04.149371 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-6c10e609-3b9c-46c9-b29c-a0942e042337 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 24ad6e3e-6043-4eff-afb4-0c6039e825fa] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:23:04.156509 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-6c10e609-3b9c-46c9-b29c-a0942e042337 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:04.162000 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-6c10e609-3b9c-46c9-b29c-a0942e042337 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:04.165993 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-6c10e609-3b9c-46c9-b29c-a0942e042337 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:04.167895 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-6c10e609-3b9c-46c9-b29c-a0942e042337 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:04.169853 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-6c10e609-3b9c-46c9-b29c-a0942e042337 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:04.172426 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-6c10e609-3b9c-46c9-b29c-a0942e042337 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:04.194446 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.virt.hardware [None req-79f0a6ce-ca49-4177-b1c4-7105e1c326ad tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Flavor limits 0:0:0 {{(pid=118726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 19:23:04.194941 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.virt.hardware [None req-79f0a6ce-ca49-4177-b1c4-7105e1c326ad tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Image limits 0:0:0 {{(pid=118726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 19:23:04.195622 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.virt.hardware [None req-79f0a6ce-ca49-4177-b1c4-7105e1c326ad tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Flavor pref 0:0:0 {{(pid=118726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 19:23:04.196034 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.virt.hardware [None req-79f0a6ce-ca49-4177-b1c4-7105e1c326ad tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Image pref 0:0:0 {{(pid=118726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 19:23:04.196443 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.virt.hardware [None req-79f0a6ce-ca49-4177-b1c4-7105e1c326ad tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 19:23:04.210298 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-79f0a6ce-ca49-4177-b1c4-7105e1c326ad tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:04.211021 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-79f0a6ce-ca49-4177-b1c4-7105e1c326ad tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:04.211651 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-79f0a6ce-ca49-4177-b1c4-7105e1c326ad tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:04.213643 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-79f0a6ce-ca49-4177-b1c4-7105e1c326ad tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:04.215212 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-79f0a6ce-ca49-4177-b1c4-7105e1c326ad tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:04.215850 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-79f0a6ce-ca49-4177-b1c4-7105e1c326ad tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:04.246867 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.quota [None req-79f0a6ce-ca49-4177-b1c4-7105e1c326ad tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Getting quotas for project 73cf63c76fc543428404002ae9a75b29. Resources: {'instances', 'ram', 'cores'} {{(pid=118726) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 19:23:04.251699 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.quota [None req-79f0a6ce-ca49-4177-b1c4-7105e1c326ad tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Getting quotas for user ddc49f9eb3114759b2889ed8972136d8 and project 73cf63c76fc543428404002ae9a75b29. Resources: {'instances', 'ram', 'cores'} {{(pid=118726) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 19:23:04.264934 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-79f0a6ce-ca49-4177-b1c4-7105e1c326ad tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Going to run 1 instances... {{(pid=118726) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 19:23:04.267816 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-79f0a6ce-ca49-4177-b1c4-7105e1c326ad tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 3097dda0-1cb7-439c-b44a-898c488a6448] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9795ee0-6722-4e1e-8fc8-a6c2e68f3049',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118726) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 19:23:04.404531 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-79f0a6ce-ca49-4177-b1c4-7105e1c326ad tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.863278 Oct 31 19:23:04.412247 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 140/284] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 31 19:23:02 2022] POST /compute/v2.1/servers => generated 406 bytes in 1872 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 19:23:04.420992 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-b9b6cb91-bbb8-4231-ba08-c46a5dffc8dc tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:23:04.421872 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-b9b6cb91-bbb8-4231-ba08-c46a5dffc8dc tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 3097dda0-1cb7-439c-b44a-898c488a6448] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:23:04.467305 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-6c10e609-3b9c-46c9-b29c-a0942e042337 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:04.497990 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-b9b6cb91-bbb8-4231-ba08-c46a5dffc8dc tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc49f9eb3114759b2889ed8972136d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cf63c76fc543428404002ae9a75b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:04.499652 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-6c10e609-3b9c-46c9-b29c-a0942e042337 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:04.504944 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-6c10e609-3b9c-46c9-b29c-a0942e042337 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:04.506310 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-6c10e609-3b9c-46c9-b29c-a0942e042337 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa" status: 200 len: 1724 microversion: 2.20 time: 0.361791 Oct 31 19:23:04.506914 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 145/285] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 31 19:23:04 2022] GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa => generated 1724 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 19:23:04.528732 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-b9b6cb91-bbb8-4231-ba08-c46a5dffc8dc tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/3097dda0-1cb7-439c-b44a-898c488a6448" status: 200 len: 1246 microversion: 2.1 time: 0.106893 Oct 31 19:23:04.535906 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 141/286] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:23:04 2022] GET /compute/v2.1/servers/3097dda0-1cb7-439c-b44a-898c488a6448 => generated 1246 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:23:04.604624 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-4b508cc2-0ed3-4e72-b3f2-e782ff762b79 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:23:04.605829 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-4b508cc2-0ed3-4e72-b3f2-e782ff762b79 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] [instance: 0a122a08-bc0f-40fd-8139-74c9e8a70ebe] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:23:04.609574 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG dbcounter [-] [118727] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=1 {{(pid=118727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:23:04.622029 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-4b508cc2-0ed3-4e72-b3f2-e782ff762b79 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:04.622520 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-4b508cc2-0ed3-4e72-b3f2-e782ff762b79 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:04.622957 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-4b508cc2-0ed3-4e72-b3f2-e782ff762b79 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:04.623747 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-4b508cc2-0ed3-4e72-b3f2-e782ff762b79 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:04.625409 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-4b508cc2-0ed3-4e72-b3f2-e782ff762b79 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:04.625889 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-4b508cc2-0ed3-4e72-b3f2-e782ff762b79 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:05.002158 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-4b508cc2-0ed3-4e72-b3f2-e782ff762b79 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ece6ca9374764214bac6263bd691bc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9c317b548b40deb8cb27236d36d674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:05.047885 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-4b508cc2-0ed3-4e72-b3f2-e782ff762b79 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] 10.222.0.16 "GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe" status: 200 len: 1721 microversion: 2.1 time: 0.448099 Oct 31 19:23:05.071910 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 146/287] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:23:04 2022] GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe => generated 1721 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 19:23:05.536797 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-5fdc5ccc-b0db-4f69-b530-86537b55d532 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:23:05.538617 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-5fdc5ccc-b0db-4f69-b530-86537b55d532 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 24ad6e3e-6043-4eff-afb4-0c6039e825fa] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:23:05.555237 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-24c8d1c8-a4fb-46f6-ac26-65da2b41d609 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:23:05.555790 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-24c8d1c8-a4fb-46f6-ac26-65da2b41d609 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 3097dda0-1cb7-439c-b44a-898c488a6448] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:23:05.569237 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-5fdc5ccc-b0db-4f69-b530-86537b55d532 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:05.570273 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-5fdc5ccc-b0db-4f69-b530-86537b55d532 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:05.572350 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-5fdc5ccc-b0db-4f69-b530-86537b55d532 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:05.573720 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-5fdc5ccc-b0db-4f69-b530-86537b55d532 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:05.574676 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-24c8d1c8-a4fb-46f6-ac26-65da2b41d609 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:05.575331 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-5fdc5ccc-b0db-4f69-b530-86537b55d532 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:05.575968 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-24c8d1c8-a4fb-46f6-ac26-65da2b41d609 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:05.576617 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-5fdc5ccc-b0db-4f69-b530-86537b55d532 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:05.577199 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-24c8d1c8-a4fb-46f6-ac26-65da2b41d609 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:05.580602 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-24c8d1c8-a4fb-46f6-ac26-65da2b41d609 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:05.581397 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-24c8d1c8-a4fb-46f6-ac26-65da2b41d609 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:05.582116 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-24c8d1c8-a4fb-46f6-ac26-65da2b41d609 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:05.752020 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-24c8d1c8-a4fb-46f6-ac26-65da2b41d609 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc49f9eb3114759b2889ed8972136d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cf63c76fc543428404002ae9a75b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:05.762090 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-24c8d1c8-a4fb-46f6-ac26-65da2b41d609 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/3097dda0-1cb7-439c-b44a-898c488a6448" status: 200 len: 1250 microversion: 2.1 time: 0.212194 Oct 31 19:23:05.772749 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 147/288] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:23:05 2022] GET /compute/v2.1/servers/3097dda0-1cb7-439c-b44a-898c488a6448 => generated 1250 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:23:05.817695 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-5fdc5ccc-b0db-4f69-b530-86537b55d532 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:05.832612 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-5fdc5ccc-b0db-4f69-b530-86537b55d532 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:05.834448 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-5fdc5ccc-b0db-4f69-b530-86537b55d532 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:05.836610 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-5fdc5ccc-b0db-4f69-b530-86537b55d532 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa" status: 200 len: 1724 microversion: 2.20 time: 0.305051 Oct 31 19:23:05.837277 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 142/289] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 31 19:23:05 2022] GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa => generated 1724 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 19:23:06.096780 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-6f6f2566-961b-45e1-976f-99aea07063c2 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:23:06.097454 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-6f6f2566-961b-45e1-976f-99aea07063c2 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] [instance: 0a122a08-bc0f-40fd-8139-74c9e8a70ebe] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:23:06.109199 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-6f6f2566-961b-45e1-976f-99aea07063c2 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:06.111015 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-6f6f2566-961b-45e1-976f-99aea07063c2 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:06.116834 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-6f6f2566-961b-45e1-976f-99aea07063c2 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:06.119111 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-6f6f2566-961b-45e1-976f-99aea07063c2 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:06.120144 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-6f6f2566-961b-45e1-976f-99aea07063c2 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:06.121227 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-6f6f2566-961b-45e1-976f-99aea07063c2 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:06.451585 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-6f6f2566-961b-45e1-976f-99aea07063c2 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ece6ca9374764214bac6263bd691bc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9c317b548b40deb8cb27236d36d674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:06.478243 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-6f6f2566-961b-45e1-976f-99aea07063c2 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] 10.222.0.16 "GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe" status: 200 len: 1721 microversion: 2.1 time: 0.383021 Oct 31 19:23:06.479320 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 148/290] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:23:06 2022] GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe => generated 1721 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:23:06.797068 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-5c65c996-8012-425f-aef3-162f08b29b02 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:23:06.798929 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-5c65c996-8012-425f-aef3-162f08b29b02 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 3097dda0-1cb7-439c-b44a-898c488a6448] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:23:06.833461 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-5c65c996-8012-425f-aef3-162f08b29b02 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:06.834313 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-5c65c996-8012-425f-aef3-162f08b29b02 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:06.836601 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-5c65c996-8012-425f-aef3-162f08b29b02 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:06.842160 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-5c65c996-8012-425f-aef3-162f08b29b02 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:06.845251 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-5c65c996-8012-425f-aef3-162f08b29b02 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:06.847863 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-5c65c996-8012-425f-aef3-162f08b29b02 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:06.864763 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-0c2ee018-a437-4707-83f5-04ed27e38a6d tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:23:06.865377 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-0c2ee018-a437-4707-83f5-04ed27e38a6d tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 24ad6e3e-6043-4eff-afb4-0c6039e825fa] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:23:06.914153 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-0c2ee018-a437-4707-83f5-04ed27e38a6d tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:06.919236 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-0c2ee018-a437-4707-83f5-04ed27e38a6d tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:06.921228 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-0c2ee018-a437-4707-83f5-04ed27e38a6d tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:06.924385 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-0c2ee018-a437-4707-83f5-04ed27e38a6d tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:06.926532 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-0c2ee018-a437-4707-83f5-04ed27e38a6d tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:06.926972 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-0c2ee018-a437-4707-83f5-04ed27e38a6d tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:07.079536 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-5c65c996-8012-425f-aef3-162f08b29b02 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc49f9eb3114759b2889ed8972136d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cf63c76fc543428404002ae9a75b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:07.087227 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-5c65c996-8012-425f-aef3-162f08b29b02 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/3097dda0-1cb7-439c-b44a-898c488a6448" status: 200 len: 1298 microversion: 2.1 time: 0.296572 Oct 31 19:23:07.087805 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 143/291] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:23:06 2022] GET /compute/v2.1/servers/3097dda0-1cb7-439c-b44a-898c488a6448 => generated 1298 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:23:07.427576 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-c4b8d5b2-0cc3-4140-b8ec-cc032647d250 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-2124902325", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-563463545", "security_groups": [{"name": "tempest-secgroup-smoke-1490049376"}], "networks": [{"uuid": "8bd8fec5-0f1b-4c28-a279-f78e038a6306"}], "block_device_mapping_v2": [{"uuid": "db51bba4-a478-4455-b4b4-4d13f64453e4", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:23:07.789723 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.network.neutron [None req-c4b8d5b2-0cc3-4140-b8ec-cc032647d250 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] validate_networks() for [('8bd8fec5-0f1b-4c28-a279-f78e038a6306', None, None, None, None, None)] {{(pid=118726) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 19:23:07.868667 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-0c2ee018-a437-4707-83f5-04ed27e38a6d tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:07.880456 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-0c2ee018-a437-4707-83f5-04ed27e38a6d tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:07.884864 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-0c2ee018-a437-4707-83f5-04ed27e38a6d tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:07.889843 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-0c2ee018-a437-4707-83f5-04ed27e38a6d tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa" status: 200 len: 1745 microversion: 2.20 time: 1.029860 Oct 31 19:23:07.892793 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 149/292] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 31 19:23:06 2022] GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa => generated 1745 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 19:23:07.912085 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-7f36bb71-4838-4b10-a32d-4b44d87427d6 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:23:07.913258 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-7f36bb71-4838-4b10-a32d-4b44d87427d6 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] [instance: 0a122a08-bc0f-40fd-8139-74c9e8a70ebe] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:23:07.934893 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-7f36bb71-4838-4b10-a32d-4b44d87427d6 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:07.935628 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-7f36bb71-4838-4b10-a32d-4b44d87427d6 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:07.936937 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-7f36bb71-4838-4b10-a32d-4b44d87427d6 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:07.939890 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-7f36bb71-4838-4b10-a32d-4b44d87427d6 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:07.940952 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-7f36bb71-4838-4b10-a32d-4b44d87427d6 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:07.942724 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-7f36bb71-4838-4b10-a32d-4b44d87427d6 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:08.280606 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-7f36bb71-4838-4b10-a32d-4b44d87427d6 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ece6ca9374764214bac6263bd691bc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9c317b548b40deb8cb27236d36d674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:08.297056 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-7f36bb71-4838-4b10-a32d-4b44d87427d6 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] 10.222.0.16 "GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe" status: 200 len: 1721 microversion: 2.1 time: 0.401748 Oct 31 19:23:08.298988 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 150/293] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:23:07 2022] GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe => generated 1721 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:23:08.326070 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-6afd81d2-a45d-487f-aa96-e550afa6894d tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:23:08.326698 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-6afd81d2-a45d-487f-aa96-e550afa6894d tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 3097dda0-1cb7-439c-b44a-898c488a6448] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:23:08.337506 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-6afd81d2-a45d-487f-aa96-e550afa6894d tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:08.340811 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-6afd81d2-a45d-487f-aa96-e550afa6894d tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:08.341467 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-6afd81d2-a45d-487f-aa96-e550afa6894d tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:08.344939 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-6afd81d2-a45d-487f-aa96-e550afa6894d tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:08.345777 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-6afd81d2-a45d-487f-aa96-e550afa6894d tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:08.346396 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-6afd81d2-a45d-487f-aa96-e550afa6894d tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:08.439700 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG dbcounter [-] [118727] Writing DB stats nova_cell0:SELECT=4 {{(pid=118727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:23:08.461380 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.virt.hardware [None req-c4b8d5b2-0cc3-4140-b8ec-cc032647d250 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Flavor limits 0:0:0 {{(pid=118726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 19:23:08.461890 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.virt.hardware [None req-c4b8d5b2-0cc3-4140-b8ec-cc032647d250 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Image limits 0:0:0 {{(pid=118726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 19:23:08.462355 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.virt.hardware [None req-c4b8d5b2-0cc3-4140-b8ec-cc032647d250 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Flavor pref 0:0:0 {{(pid=118726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 19:23:08.462818 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.virt.hardware [None req-c4b8d5b2-0cc3-4140-b8ec-cc032647d250 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Image pref 0:0:0 {{(pid=118726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 19:23:08.464348 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.virt.hardware [None req-c4b8d5b2-0cc3-4140-b8ec-cc032647d250 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 19:23:08.470453 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-6afd81d2-a45d-487f-aa96-e550afa6894d tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc49f9eb3114759b2889ed8972136d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cf63c76fc543428404002ae9a75b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:08.486581 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-c4b8d5b2-0cc3-4140-b8ec-cc032647d250 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:08.487086 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-c4b8d5b2-0cc3-4140-b8ec-cc032647d250 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:08.488698 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-c4b8d5b2-0cc3-4140-b8ec-cc032647d250 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:08.489741 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-c4b8d5b2-0cc3-4140-b8ec-cc032647d250 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:08.493654 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-c4b8d5b2-0cc3-4140-b8ec-cc032647d250 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:08.494634 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-6afd81d2-a45d-487f-aa96-e550afa6894d tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/3097dda0-1cb7-439c-b44a-898c488a6448" status: 200 len: 1304 microversion: 2.1 time: 0.187838 Oct 31 19:23:08.495169 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-c4b8d5b2-0cc3-4140-b8ec-cc032647d250 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:08.499143 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 151/294] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:23:08 2022] GET /compute/v2.1/servers/3097dda0-1cb7-439c-b44a-898c488a6448 => generated 1304 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:23:08.555872 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.quota [None req-c4b8d5b2-0cc3-4140-b8ec-cc032647d250 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Getting quotas for project a33bb29688304d0dae3cfdc0eb54b7be. Resources: {'instances', 'ram', 'cores'} {{(pid=118726) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 19:23:08.569398 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.quota [None req-c4b8d5b2-0cc3-4140-b8ec-cc032647d250 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Getting quotas for user d5cfee7994ab404d974d86d77e075209 and project a33bb29688304d0dae3cfdc0eb54b7be. Resources: {'instances', 'ram', 'cores'} {{(pid=118726) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 19:23:08.730797 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-c4b8d5b2-0cc3-4140-b8ec-cc032647d250 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Going to run 1 instances... {{(pid=118726) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 19:23:08.733692 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-c4b8d5b2-0cc3-4140-b8ec-cc032647d250 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] [instance: fb16e6d4-57d8-4185-9955-ec1d261b365d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='db51bba4-a478-4455-b4b4-4d13f64453e4',volume_size=None,volume_type=None)] {{(pid=118726) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 19:23:08.927394 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-1f0dc2c2-4f95-4870-821c-48cb3c9d0d22 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:23:08.929179 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-1f0dc2c2-4f95-4870-821c-48cb3c9d0d22 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 24ad6e3e-6043-4eff-afb4-0c6039e825fa] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:23:08.943002 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-1f0dc2c2-4f95-4870-821c-48cb3c9d0d22 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:08.943909 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-1f0dc2c2-4f95-4870-821c-48cb3c9d0d22 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:08.945299 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-1f0dc2c2-4f95-4870-821c-48cb3c9d0d22 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:08.946405 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-1f0dc2c2-4f95-4870-821c-48cb3c9d0d22 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:08.947329 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-1f0dc2c2-4f95-4870-821c-48cb3c9d0d22 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:08.947949 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-1f0dc2c2-4f95-4870-821c-48cb3c9d0d22 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:09.064054 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-c4b8d5b2-0cc3-4140-b8ec-cc032647d250 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.638920 Oct 31 19:23:09.065040 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 144/295] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 31 19:23:07 2022] POST /compute/v2.1/servers => generated 406 bytes in 1643 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 19:23:09.077293 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-64dbd8e7-bfb7-45d6-99b6-5fc62cd2c7b9 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:23:09.078244 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-64dbd8e7-bfb7-45d6-99b6-5fc62cd2c7b9 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] [instance: fb16e6d4-57d8-4185-9955-ec1d261b365d] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:23:09.195397 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-64dbd8e7-bfb7-45d6-99b6-5fc62cd2c7b9 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5cfee7994ab404d974d86d77e075209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33bb29688304d0dae3cfdc0eb54b7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:09.206272 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-64dbd8e7-bfb7-45d6-99b6-5fc62cd2c7b9 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] 10.222.0.16 "GET /compute/v2.1/servers/fb16e6d4-57d8-4185-9955-ec1d261b365d" status: 200 len: 1088 microversion: 2.1 time: 0.133497 Oct 31 19:23:09.206847 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 145/296] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:23:09 2022] GET /compute/v2.1/servers/fb16e6d4-57d8-4185-9955-ec1d261b365d => generated 1088 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 19:23:09.322430 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-e1199835-6fe0-4537-b64c-4698f79a99a6 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:23:09.323297 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-e1199835-6fe0-4537-b64c-4698f79a99a6 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] [instance: 0a122a08-bc0f-40fd-8139-74c9e8a70ebe] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:23:09.340240 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-e1199835-6fe0-4537-b64c-4698f79a99a6 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:09.340984 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-e1199835-6fe0-4537-b64c-4698f79a99a6 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:09.341452 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-e1199835-6fe0-4537-b64c-4698f79a99a6 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:09.342246 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-e1199835-6fe0-4537-b64c-4698f79a99a6 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:09.342711 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-e1199835-6fe0-4537-b64c-4698f79a99a6 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:09.343147 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-e1199835-6fe0-4537-b64c-4698f79a99a6 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:09.423895 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-1f0dc2c2-4f95-4870-821c-48cb3c9d0d22 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:09.443077 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-1f0dc2c2-4f95-4870-821c-48cb3c9d0d22 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:09.450931 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-1f0dc2c2-4f95-4870-821c-48cb3c9d0d22 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:09.468914 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-1f0dc2c2-4f95-4870-821c-48cb3c9d0d22 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa" status: 200 len: 1745 microversion: 2.20 time: 0.547217 Oct 31 19:23:09.491207 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 152/297] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 31 19:23:08 2022] GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa => generated 1745 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 19:23:09.527239 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-b7c79e96-5388-4c4f-9002-1a2c81911546 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:23:09.528033 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-b7c79e96-5388-4c4f-9002-1a2c81911546 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 3097dda0-1cb7-439c-b44a-898c488a6448] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:23:09.562780 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-b7c79e96-5388-4c4f-9002-1a2c81911546 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:09.563284 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-b7c79e96-5388-4c4f-9002-1a2c81911546 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:09.564254 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-b7c79e96-5388-4c4f-9002-1a2c81911546 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:09.564980 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-b7c79e96-5388-4c4f-9002-1a2c81911546 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:09.565440 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-b7c79e96-5388-4c4f-9002-1a2c81911546 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:09.575970 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-b7c79e96-5388-4c4f-9002-1a2c81911546 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:09.726556 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-e1199835-6fe0-4537-b64c-4698f79a99a6 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ece6ca9374764214bac6263bd691bc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9c317b548b40deb8cb27236d36d674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:09.753439 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-e1199835-6fe0-4537-b64c-4698f79a99a6 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] 10.222.0.16 "GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe" status: 200 len: 1721 microversion: 2.1 time: 0.431989 Oct 31 19:23:09.755744 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 146/298] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:23:09 2022] GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe => generated 1721 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:23:09.967105 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [req-920e504d-48f4-45fe-a9e8-683d85267924 req-22e8440b-83be-4d41-a464-5440a6bcc629 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24ad6e3e-6043-4eff-afb4-0c6039e825fa", "name": "network-vif-plugged", "status": "completed", "tag": "3807af14-6f9a-4bcc-86d0-c9961d4697ae"}]} {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:23:09.992616 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [req-920e504d-48f4-45fe-a9e8-683d85267924 req-22e8440b-83be-4d41-a464-5440a6bcc629 service nova] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:09.993997 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [req-920e504d-48f4-45fe-a9e8-683d85267924 req-22e8440b-83be-4d41-a464-5440a6bcc629 service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:09.995809 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [req-920e504d-48f4-45fe-a9e8-683d85267924 req-22e8440b-83be-4d41-a464-5440a6bcc629 service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:10.020718 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.compute.server_external_events [req-920e504d-48f4-45fe-a9e8-683d85267924 req-22e8440b-83be-4d41-a464-5440a6bcc629 service nova] Creating event network-vif-plugged:3807af14-6f9a-4bcc-86d0-c9961d4697ae for instance 24ad6e3e-6043-4eff-afb4-0c6039e825fa on hv-cinder-86309 Oct 31 19:23:10.033365 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [req-920e504d-48f4-45fe-a9e8-683d85267924 req-22e8440b-83be-4d41-a464-5440a6bcc629 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069954 Oct 31 19:23:10.036527 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 147/299] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 31 19:23:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 19:23:10.193363 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-b7c79e96-5388-4c4f-9002-1a2c81911546 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc49f9eb3114759b2889ed8972136d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cf63c76fc543428404002ae9a75b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:10.210860 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-b7c79e96-5388-4c4f-9002-1a2c81911546 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/3097dda0-1cb7-439c-b44a-898c488a6448" status: 200 len: 1369 microversion: 2.1 time: 0.693967 Oct 31 19:23:10.211531 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 153/300] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:23:09 2022] GET /compute/v2.1/servers/3097dda0-1cb7-439c-b44a-898c488a6448 => generated 1369 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:23:10.239876 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-acf520a3-aaff-4287-a017-28ad4a177264 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:23:10.241988 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-acf520a3-aaff-4287-a017-28ad4a177264 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] [instance: fb16e6d4-57d8-4185-9955-ec1d261b365d] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:23:10.258759 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-acf520a3-aaff-4287-a017-28ad4a177264 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:10.259554 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-acf520a3-aaff-4287-a017-28ad4a177264 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:10.261245 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-acf520a3-aaff-4287-a017-28ad4a177264 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:10.262751 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-acf520a3-aaff-4287-a017-28ad4a177264 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:10.264637 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-acf520a3-aaff-4287-a017-28ad4a177264 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:10.266707 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-acf520a3-aaff-4287-a017-28ad4a177264 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:10.385908 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-acf520a3-aaff-4287-a017-28ad4a177264 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5cfee7994ab404d974d86d77e075209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33bb29688304d0dae3cfdc0eb54b7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:10.401223 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-acf520a3-aaff-4287-a017-28ad4a177264 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] 10.222.0.16 "GET /compute/v2.1/servers/fb16e6d4-57d8-4185-9955-ec1d261b365d" status: 200 len: 1130 microversion: 2.1 time: 0.172988 Oct 31 19:23:10.414664 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 148/301] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:23:10 2022] GET /compute/v2.1/servers/fb16e6d4-57d8-4185-9955-ec1d261b365d => generated 1130 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:23:10.505935 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-2b2a276e-3928-4f5b-9bef-be0854a4aff4 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:23:10.506551 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-2b2a276e-3928-4f5b-9bef-be0854a4aff4 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 24ad6e3e-6043-4eff-afb4-0c6039e825fa] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:23:10.513515 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-2b2a276e-3928-4f5b-9bef-be0854a4aff4 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:10.515410 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-2b2a276e-3928-4f5b-9bef-be0854a4aff4 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:10.518473 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-2b2a276e-3928-4f5b-9bef-be0854a4aff4 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:10.522524 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-2b2a276e-3928-4f5b-9bef-be0854a4aff4 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:10.523507 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-2b2a276e-3928-4f5b-9bef-be0854a4aff4 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:10.528778 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-2b2a276e-3928-4f5b-9bef-be0854a4aff4 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:10.782834 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-585b1680-d88c-48bb-9b1d-94dea234e338 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:23:10.783517 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-585b1680-d88c-48bb-9b1d-94dea234e338 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] [instance: 0a122a08-bc0f-40fd-8139-74c9e8a70ebe] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:23:10.794851 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-585b1680-d88c-48bb-9b1d-94dea234e338 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:10.795628 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-585b1680-d88c-48bb-9b1d-94dea234e338 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:10.796253 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-585b1680-d88c-48bb-9b1d-94dea234e338 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:10.797361 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-585b1680-d88c-48bb-9b1d-94dea234e338 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:10.798787 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-585b1680-d88c-48bb-9b1d-94dea234e338 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:10.799523 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-585b1680-d88c-48bb-9b1d-94dea234e338 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:10.825092 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-2b2a276e-3928-4f5b-9bef-be0854a4aff4 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:10.858499 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-2b2a276e-3928-4f5b-9bef-be0854a4aff4 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:10.865478 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-2b2a276e-3928-4f5b-9bef-be0854a4aff4 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:10.872522 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-2b2a276e-3928-4f5b-9bef-be0854a4aff4 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa" status: 200 len: 1740 microversion: 2.20 time: 0.371240 Oct 31 19:23:10.873124 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 154/302] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 31 19:23:10 2022] GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa => generated 1740 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 19:23:11.071822 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [req-6668c18e-3d4c-4ab9-b08c-6ba6ed2731df req-f9db952d-5c71-477b-9e6d-fbc84e3d54db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3097dda0-1cb7-439c-b44a-898c488a6448", "tag": "47bfb5db-2a8e-49bb-8942-819d0c5b71da"}]} {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:23:11.072882 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-585b1680-d88c-48bb-9b1d-94dea234e338 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ece6ca9374764214bac6263bd691bc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9c317b548b40deb8cb27236d36d674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:11.082244 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-585b1680-d88c-48bb-9b1d-94dea234e338 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] 10.222.0.16 "GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe" status: 200 len: 1721 microversion: 2.1 time: 0.303437 Oct 31 19:23:11.086891 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [req-6668c18e-3d4c-4ab9-b08c-6ba6ed2731df req-f9db952d-5c71-477b-9e6d-fbc84e3d54db service nova] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:11.087599 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [req-6668c18e-3d4c-4ab9-b08c-6ba6ed2731df req-f9db952d-5c71-477b-9e6d-fbc84e3d54db service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:11.088207 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [req-6668c18e-3d4c-4ab9-b08c-6ba6ed2731df req-f9db952d-5c71-477b-9e6d-fbc84e3d54db service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:11.094315 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 149/303] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:23:10 2022] GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe => generated 1721 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:23:11.102264 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.compute.server_external_events [req-6668c18e-3d4c-4ab9-b08c-6ba6ed2731df req-f9db952d-5c71-477b-9e6d-fbc84e3d54db service nova] Creating event network-changed:47bfb5db-2a8e-49bb-8942-819d0c5b71da for instance 3097dda0-1cb7-439c-b44a-898c488a6448 on hv-cinder-86309 Oct 31 19:23:11.117988 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [req-6668c18e-3d4c-4ab9-b08c-6ba6ed2731df req-f9db952d-5c71-477b-9e6d-fbc84e3d54db service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040987 Oct 31 19:23:11.123729 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 155/304] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 31 19:23:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 19:23:11.240064 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-d374f931-0391-4327-bfc0-6f44f1509a1c tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:23:11.240879 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-d374f931-0391-4327-bfc0-6f44f1509a1c tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 3097dda0-1cb7-439c-b44a-898c488a6448] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:23:11.281808 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-d374f931-0391-4327-bfc0-6f44f1509a1c tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:11.283573 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-d374f931-0391-4327-bfc0-6f44f1509a1c tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:11.285290 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-d374f931-0391-4327-bfc0-6f44f1509a1c tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:11.286336 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-d374f931-0391-4327-bfc0-6f44f1509a1c tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:11.288927 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-d374f931-0391-4327-bfc0-6f44f1509a1c tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:11.301352 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-d374f931-0391-4327-bfc0-6f44f1509a1c tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:11.427000 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-11821620-79f5-47a5-a81b-f33716110740 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:23:11.428187 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-11821620-79f5-47a5-a81b-f33716110740 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] [instance: fb16e6d4-57d8-4185-9955-ec1d261b365d] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:23:11.446181 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-11821620-79f5-47a5-a81b-f33716110740 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:11.447267 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-11821620-79f5-47a5-a81b-f33716110740 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:11.452372 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-11821620-79f5-47a5-a81b-f33716110740 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:11.456387 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-11821620-79f5-47a5-a81b-f33716110740 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:11.456985 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-11821620-79f5-47a5-a81b-f33716110740 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:11.458274 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-11821620-79f5-47a5-a81b-f33716110740 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:11.576217 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-d374f931-0391-4327-bfc0-6f44f1509a1c tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc49f9eb3114759b2889ed8972136d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cf63c76fc543428404002ae9a75b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:11.587765 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-d374f931-0391-4327-bfc0-6f44f1509a1c tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/3097dda0-1cb7-439c-b44a-898c488a6448" status: 200 len: 1369 microversion: 2.1 time: 0.351639 Oct 31 19:23:11.589137 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 150/305] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:23:11 2022] GET /compute/v2.1/servers/3097dda0-1cb7-439c-b44a-898c488a6448 => generated 1369 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:23:11.831756 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-11821620-79f5-47a5-a81b-f33716110740 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5cfee7994ab404d974d86d77e075209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33bb29688304d0dae3cfdc0eb54b7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:11.839864 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-11821620-79f5-47a5-a81b-f33716110740 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] 10.222.0.16 "GET /compute/v2.1/servers/fb16e6d4-57d8-4185-9955-ec1d261b365d" status: 200 len: 1186 microversion: 2.1 time: 0.417227 Oct 31 19:23:11.840662 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 156/306] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:23:11 2022] GET /compute/v2.1/servers/fb16e6d4-57d8-4185-9955-ec1d261b365d => generated 1186 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:23:11.900344 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-448565e9-cff0-4195-b28d-4726eebdbefe tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:23:11.901034 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-448565e9-cff0-4195-b28d-4726eebdbefe tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 24ad6e3e-6043-4eff-afb4-0c6039e825fa] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:23:11.911498 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-448565e9-cff0-4195-b28d-4726eebdbefe tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:11.912268 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-448565e9-cff0-4195-b28d-4726eebdbefe tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:11.912865 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-448565e9-cff0-4195-b28d-4726eebdbefe tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:11.914338 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-448565e9-cff0-4195-b28d-4726eebdbefe tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:11.914995 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-448565e9-cff0-4195-b28d-4726eebdbefe tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:11.915773 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-448565e9-cff0-4195-b28d-4726eebdbefe tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:12.090315 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-448565e9-cff0-4195-b28d-4726eebdbefe tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:12.100380 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-448565e9-cff0-4195-b28d-4726eebdbefe tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:12.102272 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-448565e9-cff0-4195-b28d-4726eebdbefe tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:12.103880 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-448565e9-cff0-4195-b28d-4726eebdbefe tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa" status: 200 len: 1740 microversion: 2.20 time: 0.209281 Oct 31 19:23:12.117642 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-a4f67092-a094-4e86-9c10-abfa96b963fc tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:23:12.117642 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-a4f67092-a094-4e86-9c10-abfa96b963fc tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] [instance: 0a122a08-bc0f-40fd-8139-74c9e8a70ebe] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:23:12.118487 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 151/307] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 31 19:23:11 2022] GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa => generated 1740 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 19:23:12.133048 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-a4f67092-a094-4e86-9c10-abfa96b963fc tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:12.135373 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-a4f67092-a094-4e86-9c10-abfa96b963fc tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:12.135888 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-a4f67092-a094-4e86-9c10-abfa96b963fc tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:12.137048 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-a4f67092-a094-4e86-9c10-abfa96b963fc tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:12.137591 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-a4f67092-a094-4e86-9c10-abfa96b963fc tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:12.138181 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-a4f67092-a094-4e86-9c10-abfa96b963fc tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:12.511032 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-bf42996e-da15-471e-a949-cf7588429164 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Action: 'create', calling method: .version_select at 0x7f34f20cfe50>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-916769467", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBExffdYQi8QrshNGCew672yiM3mMx4fVTtk7fVisNCmBS8S+s2DY3eaYAkzoBdEXK2TDJUu1NJlzWrMKuhoWXckERt5g4fDGWmMoGAJhLScqlXdi7dQVcmyP72SK+K1USg=="}} {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:23:12.538879 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-a4f67092-a094-4e86-9c10-abfa96b963fc tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ece6ca9374764214bac6263bd691bc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9c317b548b40deb8cb27236d36d674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:12.549069 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.quota [None req-bf42996e-da15-471e-a949-cf7588429164 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Getting quotas for project c47ae1789d284a72bb71a6ffe55e7d8b. Resources: {'key_pairs'} {{(pid=118726) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 19:23:12.557992 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-a4f67092-a094-4e86-9c10-abfa96b963fc tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] 10.222.0.16 "GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe" status: 200 len: 1721 microversion: 2.1 time: 0.453327 Oct 31 19:23:12.560054 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.quota [None req-bf42996e-da15-471e-a949-cf7588429164 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Getting quotas for user 34b652cca4b94e188b7362606edabb30 and project c47ae1789d284a72bb71a6ffe55e7d8b. Resources: {'key_pairs'} {{(pid=118726) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 19:23:12.575883 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 157/308] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:23:12 2022] GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe => generated 1721 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:23:12.612872 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-bf42996e-da15-471e-a949-cf7588429164 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.105783 Oct 31 19:23:12.614863 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 152/309] 10.222.0.16 () {60 vars in 1159 bytes} [Mon Oct 31 19:23:12 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:23:12.617829 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-4bd5e496-4f0b-4bfc-ba1e-d9a8c0a32883 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:23:12.618646 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-4bd5e496-4f0b-4bfc-ba1e-d9a8c0a32883 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 3097dda0-1cb7-439c-b44a-898c488a6448] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:23:12.626478 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-4bd5e496-4f0b-4bfc-ba1e-d9a8c0a32883 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:12.627221 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-4bd5e496-4f0b-4bfc-ba1e-d9a8c0a32883 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:12.628494 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-4bd5e496-4f0b-4bfc-ba1e-d9a8c0a32883 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:12.630122 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-4bd5e496-4f0b-4bfc-ba1e-d9a8c0a32883 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:12.631768 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-4bd5e496-4f0b-4bfc-ba1e-d9a8c0a32883 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:12.632309 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-4bd5e496-4f0b-4bfc-ba1e-d9a8c0a32883 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:12.807125 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-0e9ccec2-11c0-45a5-833f-13d550f0fbb2 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1095574899", "imageRef": "d7203777-37a3-48ff-a6a0-8e4ec959b639", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-916769467", "networks": [{"uuid": "c6bf2493-20fd-4374-968a-63f86eb3e413"}]}} {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:23:13.070236 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.network.neutron [None req-0e9ccec2-11c0-45a5-833f-13d550f0fbb2 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] validate_networks() for [('c6bf2493-20fd-4374-968a-63f86eb3e413', None, None, None, None, None)] {{(pid=118726) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 19:23:13.315359 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-4bd5e496-4f0b-4bfc-ba1e-d9a8c0a32883 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc49f9eb3114759b2889ed8972136d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cf63c76fc543428404002ae9a75b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:13.337434 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-4bd5e496-4f0b-4bfc-ba1e-d9a8c0a32883 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/3097dda0-1cb7-439c-b44a-898c488a6448" status: 200 len: 1369 microversion: 2.1 time: 0.724333 Oct 31 19:23:13.358476 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 158/310] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:23:12 2022] GET /compute/v2.1/servers/3097dda0-1cb7-439c-b44a-898c488a6448 => generated 1369 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:23:13.372011 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-19e92aab-8d0f-4642-b96c-24fcd4163fd7 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:23:13.373948 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-19e92aab-8d0f-4642-b96c-24fcd4163fd7 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] [instance: fb16e6d4-57d8-4185-9955-ec1d261b365d] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:23:13.412916 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-19e92aab-8d0f-4642-b96c-24fcd4163fd7 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:13.421693 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-19e92aab-8d0f-4642-b96c-24fcd4163fd7 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:13.422734 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-19e92aab-8d0f-4642-b96c-24fcd4163fd7 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:13.423656 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-19e92aab-8d0f-4642-b96c-24fcd4163fd7 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:13.424925 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-19e92aab-8d0f-4642-b96c-24fcd4163fd7 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:13.425524 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-19e92aab-8d0f-4642-b96c-24fcd4163fd7 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:13.601091 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-19e92aab-8d0f-4642-b96c-24fcd4163fd7 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5cfee7994ab404d974d86d77e075209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33bb29688304d0dae3cfdc0eb54b7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:13.612617 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-19e92aab-8d0f-4642-b96c-24fcd4163fd7 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] 10.222.0.16 "GET /compute/v2.1/servers/fb16e6d4-57d8-4185-9955-ec1d261b365d" status: 200 len: 1192 microversion: 2.1 time: 0.248812 Oct 31 19:23:13.613229 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 159/311] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:23:13 2022] GET /compute/v2.1/servers/fb16e6d4-57d8-4185-9955-ec1d261b365d => generated 1192 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:23:13.620787 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-e4ea4ca0-69dd-4fe5-864c-700415d113e6 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:23:13.621567 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-e4ea4ca0-69dd-4fe5-864c-700415d113e6 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 24ad6e3e-6043-4eff-afb4-0c6039e825fa] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:23:13.631859 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-e4ea4ca0-69dd-4fe5-864c-700415d113e6 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:13.632711 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-e4ea4ca0-69dd-4fe5-864c-700415d113e6 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:13.634386 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-e4ea4ca0-69dd-4fe5-864c-700415d113e6 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:13.635194 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-e4ea4ca0-69dd-4fe5-864c-700415d113e6 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:13.635844 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-e4ea4ca0-69dd-4fe5-864c-700415d113e6 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:13.637090 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-e4ea4ca0-69dd-4fe5-864c-700415d113e6 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:13.766037 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.virt.hardware [None req-0e9ccec2-11c0-45a5-833f-13d550f0fbb2 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Flavor limits 0:0:0 {{(pid=118726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 19:23:13.766491 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.virt.hardware [None req-0e9ccec2-11c0-45a5-833f-13d550f0fbb2 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Image limits 0:0:0 {{(pid=118726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 19:23:13.768486 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.virt.hardware [None req-0e9ccec2-11c0-45a5-833f-13d550f0fbb2 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Flavor pref 0:0:0 {{(pid=118726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 19:23:13.768914 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.virt.hardware [None req-0e9ccec2-11c0-45a5-833f-13d550f0fbb2 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Image pref 0:0:0 {{(pid=118726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 19:23:13.769340 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.virt.hardware [None req-0e9ccec2-11c0-45a5-833f-13d550f0fbb2 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 19:23:13.794275 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-0e9ccec2-11c0-45a5-833f-13d550f0fbb2 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:13.795409 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-0e9ccec2-11c0-45a5-833f-13d550f0fbb2 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:13.798770 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-0e9ccec2-11c0-45a5-833f-13d550f0fbb2 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:13.799824 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-0e9ccec2-11c0-45a5-833f-13d550f0fbb2 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:13.801916 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-0e9ccec2-11c0-45a5-833f-13d550f0fbb2 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:13.802597 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-0e9ccec2-11c0-45a5-833f-13d550f0fbb2 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:13.849641 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG dbcounter [-] [118726] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=118726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:23:13.858608 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.quota [None req-0e9ccec2-11c0-45a5-833f-13d550f0fbb2 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Getting quotas for project c47ae1789d284a72bb71a6ffe55e7d8b. Resources: {'instances', 'ram', 'cores'} {{(pid=118726) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 19:23:13.867032 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.quota [None req-0e9ccec2-11c0-45a5-833f-13d550f0fbb2 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Getting quotas for user 34b652cca4b94e188b7362606edabb30 and project c47ae1789d284a72bb71a6ffe55e7d8b. Resources: {'instances', 'ram', 'cores'} {{(pid=118726) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 19:23:13.887294 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-0e9ccec2-11c0-45a5-833f-13d550f0fbb2 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Going to run 1 instances... {{(pid=118726) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 19:23:13.890157 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-0e9ccec2-11c0-45a5-833f-13d550f0fbb2 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] [instance: ecd39339-b802-43f3-aba3-432fd6e5387e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d7203777-37a3-48ff-a6a0-8e4ec959b639',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118726) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 19:23:13.934640 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-e4ea4ca0-69dd-4fe5-864c-700415d113e6 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:13.947674 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-e4ea4ca0-69dd-4fe5-864c-700415d113e6 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:13.953407 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-e4ea4ca0-69dd-4fe5-864c-700415d113e6 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:13.954678 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-e4ea4ca0-69dd-4fe5-864c-700415d113e6 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa" status: 200 len: 1740 microversion: 2.20 time: 0.339994 Oct 31 19:23:13.955180 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-0e9ccec2-11c0-45a5-833f-13d550f0fbb2 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.152541 Oct 31 19:23:13.956356 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 153/312] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 31 19:23:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1155 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 19:23:13.961313 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-6e3a63b0-25ef-45bb-ae45-10c7a2aa94c8 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:23:13.962285 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-6e3a63b0-25ef-45bb-ae45-10c7a2aa94c8 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] [instance: 0a122a08-bc0f-40fd-8139-74c9e8a70ebe] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:23:13.962631 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 160/313] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 31 19:23:13 2022] GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa => generated 1740 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 19:23:13.970951 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-6e3a63b0-25ef-45bb-ae45-10c7a2aa94c8 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:13.971794 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-6e3a63b0-25ef-45bb-ae45-10c7a2aa94c8 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:13.972499 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-6e3a63b0-25ef-45bb-ae45-10c7a2aa94c8 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:13.973551 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-6e3a63b0-25ef-45bb-ae45-10c7a2aa94c8 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:13.974473 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-6e3a63b0-25ef-45bb-ae45-10c7a2aa94c8 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:13.975119 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-6e3a63b0-25ef-45bb-ae45-10c7a2aa94c8 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:13.975595 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-776e1d42-191a-4d18-b887-32d358b3dca8 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:23:13.976218 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-776e1d42-191a-4d18-b887-32d358b3dca8 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] [instance: ecd39339-b802-43f3-aba3-432fd6e5387e] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:23:14.117291 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-776e1d42-191a-4d18-b887-32d358b3dca8 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b652cca4b94e188b7362606edabb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47ae1789d284a72bb71a6ffe55e7d8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:14.126931 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-776e1d42-191a-4d18-b887-32d358b3dca8 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] 10.222.0.16 "GET /compute/v2.1/servers/ecd39339-b802-43f3-aba3-432fd6e5387e" status: 200 len: 1258 microversion: 2.1 time: 0.162957 Oct 31 19:23:14.149586 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 161/314] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:23:13 2022] GET /compute/v2.1/servers/ecd39339-b802-43f3-aba3-432fd6e5387e => generated 1258 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:23:14.221089 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-6e3a63b0-25ef-45bb-ae45-10c7a2aa94c8 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ece6ca9374764214bac6263bd691bc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9c317b548b40deb8cb27236d36d674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:14.237398 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-6e3a63b0-25ef-45bb-ae45-10c7a2aa94c8 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] 10.222.0.16 "GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe" status: 200 len: 1721 microversion: 2.1 time: 0.279696 Oct 31 19:23:14.238842 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 154/315] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:23:13 2022] GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe => generated 1721 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:23:14.365666 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-423573ea-eb4b-497a-8b69-3aed07410616 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:23:14.368454 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-423573ea-eb4b-497a-8b69-3aed07410616 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 3097dda0-1cb7-439c-b44a-898c488a6448] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:23:14.379709 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-423573ea-eb4b-497a-8b69-3aed07410616 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:14.380327 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-423573ea-eb4b-497a-8b69-3aed07410616 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:14.380869 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-423573ea-eb4b-497a-8b69-3aed07410616 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:14.381721 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-423573ea-eb4b-497a-8b69-3aed07410616 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:14.382324 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-423573ea-eb4b-497a-8b69-3aed07410616 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:14.382771 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-423573ea-eb4b-497a-8b69-3aed07410616 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:14.413685 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG dbcounter [-] [118727] Writing DB stats nova_cell1:SELECT=100 {{(pid=118727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:23:14.602799 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-423573ea-eb4b-497a-8b69-3aed07410616 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc49f9eb3114759b2889ed8972136d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cf63c76fc543428404002ae9a75b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:14.615776 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-423573ea-eb4b-497a-8b69-3aed07410616 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/3097dda0-1cb7-439c-b44a-898c488a6448" status: 200 len: 1369 microversion: 2.1 time: 0.256889 Oct 31 19:23:14.624139 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 162/316] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:23:14 2022] GET /compute/v2.1/servers/3097dda0-1cb7-439c-b44a-898c488a6448 => generated 1369 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:23:14.638313 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-1e98920a-f7a1-4651-a58f-087c18d01380 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:23:14.639215 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-1e98920a-f7a1-4651-a58f-087c18d01380 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] [instance: fb16e6d4-57d8-4185-9955-ec1d261b365d] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:23:14.655438 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-1e98920a-f7a1-4651-a58f-087c18d01380 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:14.658749 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-1e98920a-f7a1-4651-a58f-087c18d01380 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:14.659212 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-1e98920a-f7a1-4651-a58f-087c18d01380 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:14.661719 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-1e98920a-f7a1-4651-a58f-087c18d01380 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:14.662555 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-1e98920a-f7a1-4651-a58f-087c18d01380 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:14.664368 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-1e98920a-f7a1-4651-a58f-087c18d01380 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:14.872885 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-1e98920a-f7a1-4651-a58f-087c18d01380 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5cfee7994ab404d974d86d77e075209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33bb29688304d0dae3cfdc0eb54b7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:14.881650 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-1e98920a-f7a1-4651-a58f-087c18d01380 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] 10.222.0.16 "GET /compute/v2.1/servers/fb16e6d4-57d8-4185-9955-ec1d261b365d" status: 200 len: 1260 microversion: 2.1 time: 0.248086 Oct 31 19:23:14.897073 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 155/317] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:23:14 2022] GET /compute/v2.1/servers/fb16e6d4-57d8-4185-9955-ec1d261b365d => generated 1260 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:23:14.989497 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-18d43da8-579f-437d-ab12-487e393bd5e3 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:23:14.990616 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-18d43da8-579f-437d-ab12-487e393bd5e3 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 24ad6e3e-6043-4eff-afb4-0c6039e825fa] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:23:14.996841 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-18d43da8-579f-437d-ab12-487e393bd5e3 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:14.997990 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-18d43da8-579f-437d-ab12-487e393bd5e3 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:14.998716 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-18d43da8-579f-437d-ab12-487e393bd5e3 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:14.999635 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-18d43da8-579f-437d-ab12-487e393bd5e3 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:15.000395 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-18d43da8-579f-437d-ab12-487e393bd5e3 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:15.000866 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-18d43da8-579f-437d-ab12-487e393bd5e3 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:15.154723 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-dea2c763-0276-4017-8046-5241039cfcab tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:23:15.155646 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-dea2c763-0276-4017-8046-5241039cfcab tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] [instance: ecd39339-b802-43f3-aba3-432fd6e5387e] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:23:15.167969 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-dea2c763-0276-4017-8046-5241039cfcab tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:15.168722 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-dea2c763-0276-4017-8046-5241039cfcab tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:15.169326 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-dea2c763-0276-4017-8046-5241039cfcab tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:15.170301 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-dea2c763-0276-4017-8046-5241039cfcab tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:15.174456 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-dea2c763-0276-4017-8046-5241039cfcab tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:15.174916 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-dea2c763-0276-4017-8046-5241039cfcab tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:15.265571 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-dea2c763-0276-4017-8046-5241039cfcab tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b652cca4b94e188b7362606edabb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47ae1789d284a72bb71a6ffe55e7d8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:15.270809 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-18d43da8-579f-437d-ab12-487e393bd5e3 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:15.275880 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-dea2c763-0276-4017-8046-5241039cfcab tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] 10.222.0.16 "GET /compute/v2.1/servers/ecd39339-b802-43f3-aba3-432fd6e5387e" status: 200 len: 1262 microversion: 2.1 time: 0.124897 Oct 31 19:23:15.276650 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 156/318] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:23:15 2022] GET /compute/v2.1/servers/ecd39339-b802-43f3-aba3-432fd6e5387e => generated 1262 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 19:23:15.281313 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-4de8e8a8-563e-40b8-a710-45e54798d83c tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:23:15.282155 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-4de8e8a8-563e-40b8-a710-45e54798d83c tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] [instance: 0a122a08-bc0f-40fd-8139-74c9e8a70ebe] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:23:15.288932 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-4de8e8a8-563e-40b8-a710-45e54798d83c tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:15.289710 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-4de8e8a8-563e-40b8-a710-45e54798d83c tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:15.290496 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-4de8e8a8-563e-40b8-a710-45e54798d83c tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:15.291484 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-4de8e8a8-563e-40b8-a710-45e54798d83c tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:15.292432 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-4de8e8a8-563e-40b8-a710-45e54798d83c tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:15.293088 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-4de8e8a8-563e-40b8-a710-45e54798d83c tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:15.304083 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-18d43da8-579f-437d-ab12-487e393bd5e3 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:15.315009 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-18d43da8-579f-437d-ab12-487e393bd5e3 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:15.316264 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-18d43da8-579f-437d-ab12-487e393bd5e3 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa" status: 200 len: 1740 microversion: 2.20 time: 0.331548 Oct 31 19:23:15.316845 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 163/319] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 31 19:23:14 2022] GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa => generated 1740 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 19:23:15.524805 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-4de8e8a8-563e-40b8-a710-45e54798d83c tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ece6ca9374764214bac6263bd691bc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9c317b548b40deb8cb27236d36d674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:15.528239 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG dbcounter [-] [118726] Writing DB stats nova_cell1:SELECT=100 {{(pid=118726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:23:15.538601 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-4de8e8a8-563e-40b8-a710-45e54798d83c tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] 10.222.0.16 "GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe" status: 200 len: 1721 microversion: 2.1 time: 0.259278 Oct 31 19:23:15.540282 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 157/320] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:23:15 2022] GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe => generated 1721 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:23:15.651137 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-b9fd87eb-b726-44ae-8b25-00004de8a8cf tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:23:15.651740 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-b9fd87eb-b726-44ae-8b25-00004de8a8cf tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 3097dda0-1cb7-439c-b44a-898c488a6448] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:23:15.671778 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-b9fd87eb-b726-44ae-8b25-00004de8a8cf tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:15.677339 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-b9fd87eb-b726-44ae-8b25-00004de8a8cf tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:15.678759 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-b9fd87eb-b726-44ae-8b25-00004de8a8cf tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:15.679576 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-b9fd87eb-b726-44ae-8b25-00004de8a8cf tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:15.680130 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-b9fd87eb-b726-44ae-8b25-00004de8a8cf tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:15.680550 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-b9fd87eb-b726-44ae-8b25-00004de8a8cf tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:15.905420 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-0b5b5ca0-d1e2-41f3-a7e2-39f652000d95 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:23:15.906395 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-0b5b5ca0-d1e2-41f3-a7e2-39f652000d95 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] [instance: fb16e6d4-57d8-4185-9955-ec1d261b365d] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:23:15.917460 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-0b5b5ca0-d1e2-41f3-a7e2-39f652000d95 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:15.918531 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-0b5b5ca0-d1e2-41f3-a7e2-39f652000d95 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:15.919039 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-0b5b5ca0-d1e2-41f3-a7e2-39f652000d95 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:15.920547 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-0b5b5ca0-d1e2-41f3-a7e2-39f652000d95 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:15.921869 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-0b5b5ca0-d1e2-41f3-a7e2-39f652000d95 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:15.923090 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-0b5b5ca0-d1e2-41f3-a7e2-39f652000d95 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:16.077035 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-b9fd87eb-b726-44ae-8b25-00004de8a8cf tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc49f9eb3114759b2889ed8972136d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cf63c76fc543428404002ae9a75b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:16.090263 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-b9fd87eb-b726-44ae-8b25-00004de8a8cf tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/3097dda0-1cb7-439c-b44a-898c488a6448" status: 200 len: 1369 microversion: 2.1 time: 0.443092 Oct 31 19:23:16.090853 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 164/321] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:23:15 2022] GET /compute/v2.1/servers/3097dda0-1cb7-439c-b44a-898c488a6448 => generated 1369 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:23:16.158330 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-0b5b5ca0-d1e2-41f3-a7e2-39f652000d95 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5cfee7994ab404d974d86d77e075209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33bb29688304d0dae3cfdc0eb54b7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:16.167260 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-0b5b5ca0-d1e2-41f3-a7e2-39f652000d95 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] 10.222.0.16 "GET /compute/v2.1/servers/fb16e6d4-57d8-4185-9955-ec1d261b365d" status: 200 len: 1260 microversion: 2.1 time: 0.266536 Oct 31 19:23:16.168109 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 158/322] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:23:15 2022] GET /compute/v2.1/servers/fb16e6d4-57d8-4185-9955-ec1d261b365d => generated 1260 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 19:23:16.284963 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [req-68149211-9580-44b3-a653-ac4f7cb7e962 req-2201aed9-cefd-4710-8544-8e0af03eb4fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb16e6d4-57d8-4185-9955-ec1d261b365d", "tag": "d4d5c6c7-d643-4ff8-859d-8b480d999f74"}]} {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:23:16.301365 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-8e56349a-0335-4fc8-8c49-c8a37210177a tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:23:16.304048 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-8e56349a-0335-4fc8-8c49-c8a37210177a tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] [instance: ecd39339-b802-43f3-aba3-432fd6e5387e] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:23:16.316054 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-8e56349a-0335-4fc8-8c49-c8a37210177a tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:16.318759 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [req-68149211-9580-44b3-a653-ac4f7cb7e962 req-2201aed9-cefd-4710-8544-8e0af03eb4fc service nova] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:16.319598 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-8e56349a-0335-4fc8-8c49-c8a37210177a tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:16.320303 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-8e56349a-0335-4fc8-8c49-c8a37210177a tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:16.321163 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [req-68149211-9580-44b3-a653-ac4f7cb7e962 req-2201aed9-cefd-4710-8544-8e0af03eb4fc service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:16.322126 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-8e56349a-0335-4fc8-8c49-c8a37210177a tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:16.322774 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [req-68149211-9580-44b3-a653-ac4f7cb7e962 req-2201aed9-cefd-4710-8544-8e0af03eb4fc service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:16.324570 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-8e56349a-0335-4fc8-8c49-c8a37210177a tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:16.325233 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-8e56349a-0335-4fc8-8c49-c8a37210177a tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:16.356962 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.compute.server_external_events [req-68149211-9580-44b3-a653-ac4f7cb7e962 req-2201aed9-cefd-4710-8544-8e0af03eb4fc service nova] Creating event network-changed:d4d5c6c7-d643-4ff8-859d-8b480d999f74 for instance fb16e6d4-57d8-4185-9955-ec1d261b365d on hv-cinder-86309 Oct 31 19:23:16.386666 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [req-68149211-9580-44b3-a653-ac4f7cb7e962 req-2201aed9-cefd-4710-8544-8e0af03eb4fc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107683 Oct 31 19:23:16.390253 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 165/323] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 31 19:23:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:23:16.413293 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-a61b1331-f887-455a-a4af-cb87ade5f6bd tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:23:16.414641 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-a61b1331-f887-455a-a4af-cb87ade5f6bd tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 24ad6e3e-6043-4eff-afb4-0c6039e825fa] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:23:16.437134 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-a61b1331-f887-455a-a4af-cb87ade5f6bd tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:16.445884 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-a61b1331-f887-455a-a4af-cb87ade5f6bd tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:16.446919 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-a61b1331-f887-455a-a4af-cb87ade5f6bd tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:16.447997 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-a61b1331-f887-455a-a4af-cb87ade5f6bd tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:16.448477 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-a61b1331-f887-455a-a4af-cb87ade5f6bd tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:16.448903 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-a61b1331-f887-455a-a4af-cb87ade5f6bd tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:16.471443 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-8e56349a-0335-4fc8-8c49-c8a37210177a tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b652cca4b94e188b7362606edabb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47ae1789d284a72bb71a6ffe55e7d8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:16.487586 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-8e56349a-0335-4fc8-8c49-c8a37210177a tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] 10.222.0.16 "GET /compute/v2.1/servers/ecd39339-b802-43f3-aba3-432fd6e5387e" status: 200 len: 1310 microversion: 2.1 time: 0.190600 Oct 31 19:23:16.504323 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 159/324] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:23:16 2022] GET /compute/v2.1/servers/ecd39339-b802-43f3-aba3-432fd6e5387e => generated 1310 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:23:16.565051 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-5f2c642a-9420-40af-a82f-9810c8293700 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:23:16.565674 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-5f2c642a-9420-40af-a82f-9810c8293700 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] [instance: 0a122a08-bc0f-40fd-8139-74c9e8a70ebe] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:23:16.573748 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-5f2c642a-9420-40af-a82f-9810c8293700 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:16.575099 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-5f2c642a-9420-40af-a82f-9810c8293700 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:16.575687 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-5f2c642a-9420-40af-a82f-9810c8293700 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:16.576542 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-5f2c642a-9420-40af-a82f-9810c8293700 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:16.577209 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-5f2c642a-9420-40af-a82f-9810c8293700 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:16.578011 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-5f2c642a-9420-40af-a82f-9810c8293700 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:16.799015 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-5f2c642a-9420-40af-a82f-9810c8293700 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ece6ca9374764214bac6263bd691bc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9c317b548b40deb8cb27236d36d674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:16.807829 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-5f2c642a-9420-40af-a82f-9810c8293700 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] 10.222.0.16 "GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe" status: 200 len: 1721 microversion: 2.1 time: 0.247175 Oct 31 19:23:16.808827 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 160/325] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:23:16 2022] GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe => generated 1721 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 19:23:16.894047 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-a61b1331-f887-455a-a4af-cb87ade5f6bd tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:16.904565 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-a61b1331-f887-455a-a4af-cb87ade5f6bd tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:16.918942 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-a61b1331-f887-455a-a4af-cb87ade5f6bd tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:16.920259 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-a61b1331-f887-455a-a4af-cb87ade5f6bd tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa" status: 200 len: 1740 microversion: 2.20 time: 0.525296 Oct 31 19:23:16.925981 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 166/326] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 31 19:23:16 2022] GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa => generated 1740 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 19:23:17.117767 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-abfc3025-1f98-4b77-a85b-72c16f80a55e tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:23:17.118893 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-abfc3025-1f98-4b77-a85b-72c16f80a55e tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 3097dda0-1cb7-439c-b44a-898c488a6448] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:23:17.132197 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-abfc3025-1f98-4b77-a85b-72c16f80a55e tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:17.137863 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-abfc3025-1f98-4b77-a85b-72c16f80a55e tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:17.138576 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-abfc3025-1f98-4b77-a85b-72c16f80a55e tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:17.139921 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-abfc3025-1f98-4b77-a85b-72c16f80a55e tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:17.140927 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-abfc3025-1f98-4b77-a85b-72c16f80a55e tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:17.142121 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-abfc3025-1f98-4b77-a85b-72c16f80a55e tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:17.195379 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-81edd7cf-9f1a-4d66-a9bd-4f4b36b12dd4 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:23:17.196202 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-81edd7cf-9f1a-4d66-a9bd-4f4b36b12dd4 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] [instance: fb16e6d4-57d8-4185-9955-ec1d261b365d] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:23:17.208947 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-81edd7cf-9f1a-4d66-a9bd-4f4b36b12dd4 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:17.212555 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-81edd7cf-9f1a-4d66-a9bd-4f4b36b12dd4 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:17.216180 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-81edd7cf-9f1a-4d66-a9bd-4f4b36b12dd4 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:17.220663 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-81edd7cf-9f1a-4d66-a9bd-4f4b36b12dd4 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:17.220663 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-81edd7cf-9f1a-4d66-a9bd-4f4b36b12dd4 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:17.221212 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-81edd7cf-9f1a-4d66-a9bd-4f4b36b12dd4 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:17.393990 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-abfc3025-1f98-4b77-a85b-72c16f80a55e tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc49f9eb3114759b2889ed8972136d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cf63c76fc543428404002ae9a75b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:17.410502 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-abfc3025-1f98-4b77-a85b-72c16f80a55e tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/3097dda0-1cb7-439c-b44a-898c488a6448" status: 200 len: 1369 microversion: 2.1 time: 0.297217 Oct 31 19:23:17.411157 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 161/327] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:23:17 2022] GET /compute/v2.1/servers/3097dda0-1cb7-439c-b44a-898c488a6448 => generated 1369 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:23:17.515915 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-74935ff2-c8be-4375-aaa7-74e868b53851 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:23:17.517392 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-74935ff2-c8be-4375-aaa7-74e868b53851 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] [instance: ecd39339-b802-43f3-aba3-432fd6e5387e] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:23:17.537152 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-74935ff2-c8be-4375-aaa7-74e868b53851 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:17.537692 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-74935ff2-c8be-4375-aaa7-74e868b53851 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:17.538136 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-74935ff2-c8be-4375-aaa7-74e868b53851 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:17.538853 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-74935ff2-c8be-4375-aaa7-74e868b53851 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:17.539316 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-74935ff2-c8be-4375-aaa7-74e868b53851 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:17.539741 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-74935ff2-c8be-4375-aaa7-74e868b53851 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:17.720573 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-74935ff2-c8be-4375-aaa7-74e868b53851 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b652cca4b94e188b7362606edabb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47ae1789d284a72bb71a6ffe55e7d8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:17.732400 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-74935ff2-c8be-4375-aaa7-74e868b53851 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] 10.222.0.16 "GET /compute/v2.1/servers/ecd39339-b802-43f3-aba3-432fd6e5387e" status: 200 len: 1316 microversion: 2.1 time: 0.219053 Oct 31 19:23:17.734792 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 162/328] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:23:17 2022] GET /compute/v2.1/servers/ecd39339-b802-43f3-aba3-432fd6e5387e => generated 1316 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 19:23:17.834306 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-eb6faefa-2913-4042-bec8-b1c175259445 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:23:17.835549 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-eb6faefa-2913-4042-bec8-b1c175259445 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] [instance: 0a122a08-bc0f-40fd-8139-74c9e8a70ebe] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:23:17.852367 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-eb6faefa-2913-4042-bec8-b1c175259445 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:17.854165 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-eb6faefa-2913-4042-bec8-b1c175259445 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:17.855486 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-eb6faefa-2913-4042-bec8-b1c175259445 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:17.857066 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-eb6faefa-2913-4042-bec8-b1c175259445 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:17.859479 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-eb6faefa-2913-4042-bec8-b1c175259445 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:17.860939 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-eb6faefa-2913-4042-bec8-b1c175259445 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:17.889072 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-81edd7cf-9f1a-4d66-a9bd-4f4b36b12dd4 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5cfee7994ab404d974d86d77e075209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33bb29688304d0dae3cfdc0eb54b7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:17.898743 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-81edd7cf-9f1a-4d66-a9bd-4f4b36b12dd4 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] 10.222.0.16 "GET /compute/v2.1/servers/fb16e6d4-57d8-4185-9955-ec1d261b365d" status: 200 len: 1260 microversion: 2.1 time: 0.709185 Oct 31 19:23:17.899338 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 167/329] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:23:17 2022] GET /compute/v2.1/servers/fb16e6d4-57d8-4185-9955-ec1d261b365d => generated 1260 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 19:23:17.946688 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-b87b0f27-472a-46a1-9c53-a539cbfb3b3c tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:23:17.947292 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-b87b0f27-472a-46a1-9c53-a539cbfb3b3c tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 24ad6e3e-6043-4eff-afb4-0c6039e825fa] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:23:17.958561 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-b87b0f27-472a-46a1-9c53-a539cbfb3b3c tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:17.959276 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-b87b0f27-472a-46a1-9c53-a539cbfb3b3c tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:17.959871 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-b87b0f27-472a-46a1-9c53-a539cbfb3b3c tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:17.960579 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-b87b0f27-472a-46a1-9c53-a539cbfb3b3c tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:17.961029 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-b87b0f27-472a-46a1-9c53-a539cbfb3b3c tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:17.961448 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-b87b0f27-472a-46a1-9c53-a539cbfb3b3c tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:18.320722 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-eb6faefa-2913-4042-bec8-b1c175259445 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ece6ca9374764214bac6263bd691bc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9c317b548b40deb8cb27236d36d674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:18.333093 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-eb6faefa-2913-4042-bec8-b1c175259445 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] 10.222.0.16 "GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe" status: 200 len: 1721 microversion: 2.1 time: 0.503730 Oct 31 19:23:18.338967 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 163/330] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:23:17 2022] GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe => generated 1721 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 19:23:18.438368 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-b15414cd-1507-420f-b99f-614e89770c4b tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:23:18.439901 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-b15414cd-1507-420f-b99f-614e89770c4b tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 3097dda0-1cb7-439c-b44a-898c488a6448] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:23:18.465393 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-b15414cd-1507-420f-b99f-614e89770c4b tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:18.468945 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-b15414cd-1507-420f-b99f-614e89770c4b tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:18.470009 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-b15414cd-1507-420f-b99f-614e89770c4b tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:18.470961 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-b15414cd-1507-420f-b99f-614e89770c4b tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:18.488066 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-b15414cd-1507-420f-b99f-614e89770c4b tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:18.491816 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-b87b0f27-472a-46a1-9c53-a539cbfb3b3c tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:18.507985 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-b15414cd-1507-420f-b99f-614e89770c4b tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:18.521522 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-b87b0f27-472a-46a1-9c53-a539cbfb3b3c tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:18.529918 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-b87b0f27-472a-46a1-9c53-a539cbfb3b3c tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:18.558227 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-b87b0f27-472a-46a1-9c53-a539cbfb3b3c tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa" status: 200 len: 1740 microversion: 2.20 time: 0.613185 Oct 31 19:23:18.562435 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 168/331] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 31 19:23:17 2022] GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa => generated 1740 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 19:23:18.778937 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-66220c5e-b860-46f9-bd30-731b7ff5f893 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:23:18.781087 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-66220c5e-b860-46f9-bd30-731b7ff5f893 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] [instance: ecd39339-b802-43f3-aba3-432fd6e5387e] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:23:18.806211 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-66220c5e-b860-46f9-bd30-731b7ff5f893 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:18.811101 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-66220c5e-b860-46f9-bd30-731b7ff5f893 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:18.811902 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-66220c5e-b860-46f9-bd30-731b7ff5f893 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:18.812875 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-66220c5e-b860-46f9-bd30-731b7ff5f893 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:18.814231 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-66220c5e-b860-46f9-bd30-731b7ff5f893 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:18.821532 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-66220c5e-b860-46f9-bd30-731b7ff5f893 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:19.257561 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-66220c5e-b860-46f9-bd30-731b7ff5f893 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b652cca4b94e188b7362606edabb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47ae1789d284a72bb71a6ffe55e7d8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:19.267613 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-66220c5e-b860-46f9-bd30-731b7ff5f893 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] 10.222.0.16 "GET /compute/v2.1/servers/ecd39339-b802-43f3-aba3-432fd6e5387e" status: 200 len: 1358 microversion: 2.1 time: 0.504651 Oct 31 19:23:19.268208 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 169/332] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:23:18 2022] GET /compute/v2.1/servers/ecd39339-b802-43f3-aba3-432fd6e5387e => generated 1358 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:23:19.275147 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-16c01cf9-5db6-4314-856b-c13c665d3ffe tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:23:19.275764 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-16c01cf9-5db6-4314-856b-c13c665d3ffe tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] [instance: fb16e6d4-57d8-4185-9955-ec1d261b365d] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:23:19.304409 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-16c01cf9-5db6-4314-856b-c13c665d3ffe tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:19.304981 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-16c01cf9-5db6-4314-856b-c13c665d3ffe tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:19.305553 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-16c01cf9-5db6-4314-856b-c13c665d3ffe tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:19.306762 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-16c01cf9-5db6-4314-856b-c13c665d3ffe tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:19.307641 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-16c01cf9-5db6-4314-856b-c13c665d3ffe tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:19.308297 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-16c01cf9-5db6-4314-856b-c13c665d3ffe tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:19.570093 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-b15414cd-1507-420f-b99f-614e89770c4b tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc49f9eb3114759b2889ed8972136d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cf63c76fc543428404002ae9a75b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:19.593367 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-b15414cd-1507-420f-b99f-614e89770c4b tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/3097dda0-1cb7-439c-b44a-898c488a6448" status: 200 len: 1369 microversion: 2.1 time: 1.160768 Oct 31 19:23:19.598310 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 164/333] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:23:18 2022] GET /compute/v2.1/servers/3097dda0-1cb7-439c-b44a-898c488a6448 => generated 1369 bytes in 1168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:23:19.624267 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-58cda184-db7d-4a8f-a4c3-205ad5331ac1 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:23:19.626801 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-58cda184-db7d-4a8f-a4c3-205ad5331ac1 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] [instance: 0a122a08-bc0f-40fd-8139-74c9e8a70ebe] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:23:19.655091 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-58cda184-db7d-4a8f-a4c3-205ad5331ac1 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:19.658455 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-58cda184-db7d-4a8f-a4c3-205ad5331ac1 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:19.659109 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-58cda184-db7d-4a8f-a4c3-205ad5331ac1 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:19.660076 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-58cda184-db7d-4a8f-a4c3-205ad5331ac1 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:19.663410 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-58cda184-db7d-4a8f-a4c3-205ad5331ac1 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:19.664085 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-58cda184-db7d-4a8f-a4c3-205ad5331ac1 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:20.180082 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-58cda184-db7d-4a8f-a4c3-205ad5331ac1 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ece6ca9374764214bac6263bd691bc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9c317b548b40deb8cb27236d36d674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:20.191955 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-58cda184-db7d-4a8f-a4c3-205ad5331ac1 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] 10.222.0.16 "GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe" status: 200 len: 1721 microversion: 2.1 time: 0.592059 Oct 31 19:23:20.197410 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 165/334] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:23:19 2022] GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe => generated 1721 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:23:20.218439 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-2724eb11-69de-44dc-8ac3-ca0bade7accb tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:23:20.219079 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-2724eb11-69de-44dc-8ac3-ca0bade7accb tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 24ad6e3e-6043-4eff-afb4-0c6039e825fa] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:23:20.226576 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-2724eb11-69de-44dc-8ac3-ca0bade7accb tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:20.227095 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-2724eb11-69de-44dc-8ac3-ca0bade7accb tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:20.227541 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-2724eb11-69de-44dc-8ac3-ca0bade7accb tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:20.228282 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-2724eb11-69de-44dc-8ac3-ca0bade7accb tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:20.228742 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-2724eb11-69de-44dc-8ac3-ca0bade7accb tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:20.229195 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-2724eb11-69de-44dc-8ac3-ca0bade7accb tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:20.326819 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-16c01cf9-5db6-4314-856b-c13c665d3ffe tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5cfee7994ab404d974d86d77e075209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33bb29688304d0dae3cfdc0eb54b7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:20.351752 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-16c01cf9-5db6-4314-856b-c13c665d3ffe tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] 10.222.0.16 "GET /compute/v2.1/servers/fb16e6d4-57d8-4185-9955-ec1d261b365d" status: 200 len: 1260 microversion: 2.1 time: 1.081092 Oct 31 19:23:20.352450 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 170/335] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:23:19 2022] GET /compute/v2.1/servers/fb16e6d4-57d8-4185-9955-ec1d261b365d => generated 1260 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:23:20.373460 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [req-442ece26-f75b-4173-bd0f-3462e1493c4e req-453a7c1c-761a-40c2-86d3-b48ca444230f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3097dda0-1cb7-439c-b44a-898c488a6448", "name": "network-vif-plugged", "status": "completed", "tag": "47bfb5db-2a8e-49bb-8942-819d0c5b71da"}]} {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:23:20.409564 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [req-442ece26-f75b-4173-bd0f-3462e1493c4e req-453a7c1c-761a-40c2-86d3-b48ca444230f service nova] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:20.410188 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [req-442ece26-f75b-4173-bd0f-3462e1493c4e req-453a7c1c-761a-40c2-86d3-b48ca444230f service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:20.414983 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [req-442ece26-f75b-4173-bd0f-3462e1493c4e req-453a7c1c-761a-40c2-86d3-b48ca444230f service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:20.449690 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.compute.server_external_events [req-442ece26-f75b-4173-bd0f-3462e1493c4e req-453a7c1c-761a-40c2-86d3-b48ca444230f service nova] Creating event network-vif-plugged:47bfb5db-2a8e-49bb-8942-819d0c5b71da for instance 3097dda0-1cb7-439c-b44a-898c488a6448 on hv-cinder-86309 Oct 31 19:23:20.458763 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [req-442ece26-f75b-4173-bd0f-3462e1493c4e req-453a7c1c-761a-40c2-86d3-b48ca444230f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105118 Oct 31 19:23:20.468942 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 171/336] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 31 19:23:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:23:20.487876 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-14c30ba8-fcda-4395-af1f-dfc1c8a3f72f tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:23:20.491479 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-14c30ba8-fcda-4395-af1f-dfc1c8a3f72f tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] [instance: ecd39339-b802-43f3-aba3-432fd6e5387e] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:23:20.507455 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-14c30ba8-fcda-4395-af1f-dfc1c8a3f72f tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:20.509012 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-14c30ba8-fcda-4395-af1f-dfc1c8a3f72f tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:20.509959 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-14c30ba8-fcda-4395-af1f-dfc1c8a3f72f tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:20.512460 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-14c30ba8-fcda-4395-af1f-dfc1c8a3f72f tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:20.513917 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-14c30ba8-fcda-4395-af1f-dfc1c8a3f72f tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:20.514623 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-14c30ba8-fcda-4395-af1f-dfc1c8a3f72f tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:20.760842 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-2724eb11-69de-44dc-8ac3-ca0bade7accb tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:20.784975 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-2724eb11-69de-44dc-8ac3-ca0bade7accb tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:20.789496 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-2724eb11-69de-44dc-8ac3-ca0bade7accb tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:20.801385 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-2724eb11-69de-44dc-8ac3-ca0bade7accb tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa" status: 200 len: 1740 microversion: 2.20 time: 0.584176 Oct 31 19:23:20.802008 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 166/337] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 31 19:23:20 2022] GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa => generated 1740 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 19:23:20.809148 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-33918e66-17b3-41ae-bc22-00b117ba33ae tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:23:20.813783 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-33918e66-17b3-41ae-bc22-00b117ba33ae tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 3097dda0-1cb7-439c-b44a-898c488a6448] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:23:20.825076 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-33918e66-17b3-41ae-bc22-00b117ba33ae tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:20.826729 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-33918e66-17b3-41ae-bc22-00b117ba33ae tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:20.827384 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-33918e66-17b3-41ae-bc22-00b117ba33ae tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:20.830169 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-33918e66-17b3-41ae-bc22-00b117ba33ae tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:20.830968 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-33918e66-17b3-41ae-bc22-00b117ba33ae tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:20.834859 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-33918e66-17b3-41ae-bc22-00b117ba33ae tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:21.111393 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-33918e66-17b3-41ae-bc22-00b117ba33ae tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc49f9eb3114759b2889ed8972136d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cf63c76fc543428404002ae9a75b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:21.124817 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-33918e66-17b3-41ae-bc22-00b117ba33ae tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/3097dda0-1cb7-439c-b44a-898c488a6448" status: 200 len: 1369 microversion: 2.1 time: 0.320557 Oct 31 19:23:21.127737 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 167/338] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:23:20 2022] GET /compute/v2.1/servers/3097dda0-1cb7-439c-b44a-898c488a6448 => generated 1369 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:23:21.220873 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-2c58fd00-2900-4742-be4e-cc29119919e3 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:23:21.221782 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-2c58fd00-2900-4742-be4e-cc29119919e3 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] [instance: 0a122a08-bc0f-40fd-8139-74c9e8a70ebe] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:23:21.228964 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-2c58fd00-2900-4742-be4e-cc29119919e3 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:21.229448 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-2c58fd00-2900-4742-be4e-cc29119919e3 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:21.235424 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-2c58fd00-2900-4742-be4e-cc29119919e3 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:21.238502 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-2c58fd00-2900-4742-be4e-cc29119919e3 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:21.239056 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-2c58fd00-2900-4742-be4e-cc29119919e3 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:21.239498 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-2c58fd00-2900-4742-be4e-cc29119919e3 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:21.303108 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-14c30ba8-fcda-4395-af1f-dfc1c8a3f72f tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b652cca4b94e188b7362606edabb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47ae1789d284a72bb71a6ffe55e7d8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:21.310926 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-14c30ba8-fcda-4395-af1f-dfc1c8a3f72f tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] 10.222.0.16 "GET /compute/v2.1/servers/ecd39339-b802-43f3-aba3-432fd6e5387e" status: 200 len: 1358 microversion: 2.1 time: 0.839640 Oct 31 19:23:21.314263 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 172/339] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:23:20 2022] GET /compute/v2.1/servers/ecd39339-b802-43f3-aba3-432fd6e5387e => generated 1358 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:23:21.384319 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-0edb29e9-d142-4287-b8f9-bafd0eb6866b tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:23:21.385064 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-0edb29e9-d142-4287-b8f9-bafd0eb6866b tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] [instance: fb16e6d4-57d8-4185-9955-ec1d261b365d] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:23:21.391703 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-0edb29e9-d142-4287-b8f9-bafd0eb6866b tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:21.392443 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-0edb29e9-d142-4287-b8f9-bafd0eb6866b tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:21.393094 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-0edb29e9-d142-4287-b8f9-bafd0eb6866b tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:21.394415 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-0edb29e9-d142-4287-b8f9-bafd0eb6866b tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:21.395810 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-0edb29e9-d142-4287-b8f9-bafd0eb6866b tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:21.396991 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-0edb29e9-d142-4287-b8f9-bafd0eb6866b tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:21.542848 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-2c58fd00-2900-4742-be4e-cc29119919e3 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ece6ca9374764214bac6263bd691bc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9c317b548b40deb8cb27236d36d674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:21.551886 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-2c58fd00-2900-4742-be4e-cc29119919e3 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] 10.222.0.16 "GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe" status: 200 len: 1721 microversion: 2.1 time: 0.335184 Oct 31 19:23:21.552886 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 168/340] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:23:21 2022] GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe => generated 1721 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:23:21.768444 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-0edb29e9-d142-4287-b8f9-bafd0eb6866b tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5cfee7994ab404d974d86d77e075209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33bb29688304d0dae3cfdc0eb54b7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:21.779332 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-0edb29e9-d142-4287-b8f9-bafd0eb6866b tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] 10.222.0.16 "GET /compute/v2.1/servers/fb16e6d4-57d8-4185-9955-ec1d261b365d" status: 200 len: 1260 microversion: 2.1 time: 0.401324 Oct 31 19:23:21.781669 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 173/341] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:23:21 2022] GET /compute/v2.1/servers/fb16e6d4-57d8-4185-9955-ec1d261b365d => generated 1260 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 19:23:21.831503 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-c0d83dea-6fd2-49ed-aeac-e710dde5dfb4 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:23:21.832907 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-c0d83dea-6fd2-49ed-aeac-e710dde5dfb4 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 24ad6e3e-6043-4eff-afb4-0c6039e825fa] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:23:21.841812 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-c0d83dea-6fd2-49ed-aeac-e710dde5dfb4 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:21.853332 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-c0d83dea-6fd2-49ed-aeac-e710dde5dfb4 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:21.854136 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-c0d83dea-6fd2-49ed-aeac-e710dde5dfb4 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:21.855092 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-c0d83dea-6fd2-49ed-aeac-e710dde5dfb4 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:21.855753 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-c0d83dea-6fd2-49ed-aeac-e710dde5dfb4 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:21.856392 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-c0d83dea-6fd2-49ed-aeac-e710dde5dfb4 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:21.979695 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [req-75aae8f6-c0fb-4c2a-9be5-918a9c69e41c req-6523017b-57ce-4bb2-8a33-7f96b3c7e835 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ecd39339-b802-43f3-aba3-432fd6e5387e", "tag": "02358090-76d2-46a6-9956-91d3a84a985a"}]} {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:23:21.993194 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [req-75aae8f6-c0fb-4c2a-9be5-918a9c69e41c req-6523017b-57ce-4bb2-8a33-7f96b3c7e835 service nova] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:22.003694 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [req-75aae8f6-c0fb-4c2a-9be5-918a9c69e41c req-6523017b-57ce-4bb2-8a33-7f96b3c7e835 service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:22.004510 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [req-75aae8f6-c0fb-4c2a-9be5-918a9c69e41c req-6523017b-57ce-4bb2-8a33-7f96b3c7e835 service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:22.031119 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.compute.server_external_events [req-75aae8f6-c0fb-4c2a-9be5-918a9c69e41c req-6523017b-57ce-4bb2-8a33-7f96b3c7e835 service nova] Creating event network-changed:02358090-76d2-46a6-9956-91d3a84a985a for instance ecd39339-b802-43f3-aba3-432fd6e5387e on hv-cinder-86309 Oct 31 19:23:22.053325 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [req-75aae8f6-c0fb-4c2a-9be5-918a9c69e41c req-6523017b-57ce-4bb2-8a33-7f96b3c7e835 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075432 Oct 31 19:23:22.054507 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 174/342] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 31 19:23:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Oct 31 19:23:22.150164 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-540d825f-20cc-4ca3-b313-75114d125197 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:23:22.150446 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-c0d83dea-6fd2-49ed-aeac-e710dde5dfb4 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:22.151353 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-540d825f-20cc-4ca3-b313-75114d125197 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 3097dda0-1cb7-439c-b44a-898c488a6448] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:23:22.160881 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-c0d83dea-6fd2-49ed-aeac-e710dde5dfb4 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:22.162417 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-c0d83dea-6fd2-49ed-aeac-e710dde5dfb4 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:22.162821 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-540d825f-20cc-4ca3-b313-75114d125197 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:22.163585 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-c0d83dea-6fd2-49ed-aeac-e710dde5dfb4 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa" status: 200 len: 1740 microversion: 2.20 time: 0.337052 Oct 31 19:23:22.164146 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 169/343] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 31 19:23:21 2022] GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa => generated 1740 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 19:23:22.164472 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-540d825f-20cc-4ca3-b313-75114d125197 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:22.165696 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-540d825f-20cc-4ca3-b313-75114d125197 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:22.166429 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-540d825f-20cc-4ca3-b313-75114d125197 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:22.167139 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-540d825f-20cc-4ca3-b313-75114d125197 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:22.167572 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-540d825f-20cc-4ca3-b313-75114d125197 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:22.343696 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-980bd0f8-9b3d-443d-9ac0-c35e257a07ca tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:23:22.344456 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-980bd0f8-9b3d-443d-9ac0-c35e257a07ca tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] [instance: ecd39339-b802-43f3-aba3-432fd6e5387e] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:23:22.362058 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-980bd0f8-9b3d-443d-9ac0-c35e257a07ca tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:22.363628 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-980bd0f8-9b3d-443d-9ac0-c35e257a07ca tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:22.364285 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-980bd0f8-9b3d-443d-9ac0-c35e257a07ca tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:22.366952 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-980bd0f8-9b3d-443d-9ac0-c35e257a07ca tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:22.367753 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-980bd0f8-9b3d-443d-9ac0-c35e257a07ca tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:22.370298 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-980bd0f8-9b3d-443d-9ac0-c35e257a07ca tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:22.490128 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-540d825f-20cc-4ca3-b313-75114d125197 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc49f9eb3114759b2889ed8972136d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cf63c76fc543428404002ae9a75b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:22.501881 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-540d825f-20cc-4ca3-b313-75114d125197 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/3097dda0-1cb7-439c-b44a-898c488a6448" status: 200 len: 1369 microversion: 2.1 time: 0.353376 Oct 31 19:23:22.502781 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 175/344] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:23:22 2022] GET /compute/v2.1/servers/3097dda0-1cb7-439c-b44a-898c488a6448 => generated 1369 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 19:23:22.582467 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-e7f663ea-80e3-447f-8133-c1d9875490f6 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:23:22.582592 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-e7f663ea-80e3-447f-8133-c1d9875490f6 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] [instance: 0a122a08-bc0f-40fd-8139-74c9e8a70ebe] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:23:22.595049 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-e7f663ea-80e3-447f-8133-c1d9875490f6 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:22.595459 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-e7f663ea-80e3-447f-8133-c1d9875490f6 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:22.599037 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-e7f663ea-80e3-447f-8133-c1d9875490f6 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:22.599776 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-e7f663ea-80e3-447f-8133-c1d9875490f6 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:22.600242 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-e7f663ea-80e3-447f-8133-c1d9875490f6 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:22.605793 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-e7f663ea-80e3-447f-8133-c1d9875490f6 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:22.775278 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-980bd0f8-9b3d-443d-9ac0-c35e257a07ca tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b652cca4b94e188b7362606edabb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47ae1789d284a72bb71a6ffe55e7d8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:22.790457 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-980bd0f8-9b3d-443d-9ac0-c35e257a07ca tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] 10.222.0.16 "GET /compute/v2.1/servers/ecd39339-b802-43f3-aba3-432fd6e5387e" status: 200 len: 1358 microversion: 2.1 time: 0.451694 Oct 31 19:23:22.810814 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 170/345] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:23:22 2022] GET /compute/v2.1/servers/ecd39339-b802-43f3-aba3-432fd6e5387e => generated 1358 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:23:22.837061 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-5f9b662b-91a4-4d06-8d72-2dcfa9d343f9 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:23:22.837815 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-5f9b662b-91a4-4d06-8d72-2dcfa9d343f9 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] [instance: fb16e6d4-57d8-4185-9955-ec1d261b365d] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:23:22.869405 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-5f9b662b-91a4-4d06-8d72-2dcfa9d343f9 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:22.872691 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-5f9b662b-91a4-4d06-8d72-2dcfa9d343f9 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:22.873146 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-5f9b662b-91a4-4d06-8d72-2dcfa9d343f9 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:22.873993 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-5f9b662b-91a4-4d06-8d72-2dcfa9d343f9 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:22.874461 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-5f9b662b-91a4-4d06-8d72-2dcfa9d343f9 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:22.881644 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-5f9b662b-91a4-4d06-8d72-2dcfa9d343f9 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:23.037573 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-e7f663ea-80e3-447f-8133-c1d9875490f6 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ece6ca9374764214bac6263bd691bc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9c317b548b40deb8cb27236d36d674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:23.053371 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-e7f663ea-80e3-447f-8133-c1d9875490f6 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] 10.222.0.16 "GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe" status: 200 len: 1721 microversion: 2.1 time: 0.476208 Oct 31 19:23:23.054672 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 176/346] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:23:22 2022] GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe => generated 1721 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 19:23:23.163877 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-5f9b662b-91a4-4d06-8d72-2dcfa9d343f9 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5cfee7994ab404d974d86d77e075209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33bb29688304d0dae3cfdc0eb54b7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:23.192411 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-d0890c2b-a4a3-44e8-99c2-ce2547a7b96c tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:23:23.193231 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-d0890c2b-a4a3-44e8-99c2-ce2547a7b96c tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 24ad6e3e-6043-4eff-afb4-0c6039e825fa] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:23:23.199958 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-5f9b662b-91a4-4d06-8d72-2dcfa9d343f9 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] 10.222.0.16 "GET /compute/v2.1/servers/fb16e6d4-57d8-4185-9955-ec1d261b365d" status: 200 len: 1260 microversion: 2.1 time: 0.387899 Oct 31 19:23:23.200937 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 171/347] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:23:22 2022] GET /compute/v2.1/servers/fb16e6d4-57d8-4185-9955-ec1d261b365d => generated 1260 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:23:23.215509 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-d0890c2b-a4a3-44e8-99c2-ce2547a7b96c tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:23.217424 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-d0890c2b-a4a3-44e8-99c2-ce2547a7b96c tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:23.218891 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-d0890c2b-a4a3-44e8-99c2-ce2547a7b96c tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:23.220526 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-d0890c2b-a4a3-44e8-99c2-ce2547a7b96c tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:23.221887 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-d0890c2b-a4a3-44e8-99c2-ce2547a7b96c tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:23.222334 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-d0890c2b-a4a3-44e8-99c2-ce2547a7b96c tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:23.535177 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-b13d298d-fbfa-4e6f-b8ac-1e108f74f73a tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:23:23.536016 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-b13d298d-fbfa-4e6f-b8ac-1e108f74f73a tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 3097dda0-1cb7-439c-b44a-898c488a6448] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:23:23.550162 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-d0890c2b-a4a3-44e8-99c2-ce2547a7b96c tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:23.568282 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-b13d298d-fbfa-4e6f-b8ac-1e108f74f73a tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:23.568777 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-b13d298d-fbfa-4e6f-b8ac-1e108f74f73a tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:23.573679 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-b13d298d-fbfa-4e6f-b8ac-1e108f74f73a tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:23.575490 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-b13d298d-fbfa-4e6f-b8ac-1e108f74f73a tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:23.576003 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-b13d298d-fbfa-4e6f-b8ac-1e108f74f73a tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:23.576493 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-b13d298d-fbfa-4e6f-b8ac-1e108f74f73a tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:23.577583 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-d0890c2b-a4a3-44e8-99c2-ce2547a7b96c tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:23.582424 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-d0890c2b-a4a3-44e8-99c2-ce2547a7b96c tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:23.585828 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-d0890c2b-a4a3-44e8-99c2-ce2547a7b96c tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa" status: 200 len: 1740 microversion: 2.20 time: 0.395095 Oct 31 19:23:23.611331 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 177/348] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 31 19:23:23 2022] GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa => generated 1740 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 19:23:23.817293 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-aba17a71-ed30-45c3-b35c-cbb147aba960 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:23:23.817927 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-aba17a71-ed30-45c3-b35c-cbb147aba960 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] [instance: ecd39339-b802-43f3-aba3-432fd6e5387e] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:23:23.828197 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG dbcounter [-] [118726] Writing DB stats nova_cell0:SELECT=6 {{(pid=118726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:23:23.835405 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-aba17a71-ed30-45c3-b35c-cbb147aba960 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:23.839886 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-aba17a71-ed30-45c3-b35c-cbb147aba960 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:23.840597 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-aba17a71-ed30-45c3-b35c-cbb147aba960 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:23.841525 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-aba17a71-ed30-45c3-b35c-cbb147aba960 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:23.842256 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-aba17a71-ed30-45c3-b35c-cbb147aba960 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:23.842848 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-aba17a71-ed30-45c3-b35c-cbb147aba960 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:23.857465 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-b13d298d-fbfa-4e6f-b8ac-1e108f74f73a tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc49f9eb3114759b2889ed8972136d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cf63c76fc543428404002ae9a75b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:23.874483 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-b13d298d-fbfa-4e6f-b8ac-1e108f74f73a tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/3097dda0-1cb7-439c-b44a-898c488a6448" status: 200 len: 1562 microversion: 2.1 time: 0.348100 Oct 31 19:23:23.876266 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 172/349] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:23:23 2022] GET /compute/v2.1/servers/3097dda0-1cb7-439c-b44a-898c488a6448 => generated 1562 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:23:23.923092 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-ad5b103d-14dd-4b74-a29f-9d432ea859fb tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:23:23.925371 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-ad5b103d-14dd-4b74-a29f-9d432ea859fb tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 3097dda0-1cb7-439c-b44a-898c488a6448] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:23:23.937103 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG dbcounter [-] [118726] Writing DB stats nova_cell0:SELECT=30 {{(pid=118726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:23:23.940508 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-ad5b103d-14dd-4b74-a29f-9d432ea859fb tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:23.943527 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-ad5b103d-14dd-4b74-a29f-9d432ea859fb tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:23.944926 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-ad5b103d-14dd-4b74-a29f-9d432ea859fb tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:23.956685 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-ad5b103d-14dd-4b74-a29f-9d432ea859fb tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:23.957294 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-ad5b103d-14dd-4b74-a29f-9d432ea859fb tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:23.957934 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-ad5b103d-14dd-4b74-a29f-9d432ea859fb tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:24.063630 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-ad5b103d-14dd-4b74-a29f-9d432ea859fb tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/3097dda0-1cb7-439c-b44a-898c488a6448/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.162679 Oct 31 19:23:24.074180 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 173/350] 10.222.0.16 () {58 vars in 1275 bytes} [Mon Oct 31 19:23:23 2022] GET /compute/v2.1/servers/3097dda0-1cb7-439c-b44a-898c488a6448/os-interface => generated 284 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:23:24.085355 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-08e6765a-093c-4b16-b9e7-7e6ce018d9ac tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:23:24.087172 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-08e6765a-093c-4b16-b9e7-7e6ce018d9ac tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] [instance: 0a122a08-bc0f-40fd-8139-74c9e8a70ebe] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:23:24.097904 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-08e6765a-093c-4b16-b9e7-7e6ce018d9ac tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:24.098632 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-08e6765a-093c-4b16-b9e7-7e6ce018d9ac tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:24.099093 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-08e6765a-093c-4b16-b9e7-7e6ce018d9ac tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:24.099852 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-08e6765a-093c-4b16-b9e7-7e6ce018d9ac tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:24.101829 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-08e6765a-093c-4b16-b9e7-7e6ce018d9ac tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:24.103953 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-08e6765a-093c-4b16-b9e7-7e6ce018d9ac tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:24.127548 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG dbcounter [-] [118727] Writing DB stats nova_cell0:SELECT=2 {{(pid=118727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:23:24.241754 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-aba17a71-ed30-45c3-b35c-cbb147aba960 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b652cca4b94e188b7362606edabb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47ae1789d284a72bb71a6ffe55e7d8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:24.250334 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-aba17a71-ed30-45c3-b35c-cbb147aba960 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] 10.222.0.16 "GET /compute/v2.1/servers/ecd39339-b802-43f3-aba3-432fd6e5387e" status: 200 len: 1358 microversion: 2.1 time: 0.437364 Oct 31 19:23:24.252539 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 178/351] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:23:23 2022] GET /compute/v2.1/servers/ecd39339-b802-43f3-aba3-432fd6e5387e => generated 1358 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:23:24.265798 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-936f22db-7345-4fee-87bc-1e1b4051d70d tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:23:24.271967 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-936f22db-7345-4fee-87bc-1e1b4051d70d tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] [instance: fb16e6d4-57d8-4185-9955-ec1d261b365d] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:23:24.305562 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-936f22db-7345-4fee-87bc-1e1b4051d70d tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:24.306624 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-936f22db-7345-4fee-87bc-1e1b4051d70d tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:24.307078 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-936f22db-7345-4fee-87bc-1e1b4051d70d tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:24.308998 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-936f22db-7345-4fee-87bc-1e1b4051d70d tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:24.309487 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-936f22db-7345-4fee-87bc-1e1b4051d70d tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:24.312231 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-936f22db-7345-4fee-87bc-1e1b4051d70d tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:24.486039 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-08e6765a-093c-4b16-b9e7-7e6ce018d9ac tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ece6ca9374764214bac6263bd691bc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9c317b548b40deb8cb27236d36d674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:24.490876 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG dbcounter [-] [118726] Writing DB stats nova_cell1:SELECT=100 {{(pid=118726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:23:24.502831 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-08e6765a-093c-4b16-b9e7-7e6ce018d9ac tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] 10.222.0.16 "GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe" status: 200 len: 1721 microversion: 2.1 time: 0.423969 Oct 31 19:23:24.507637 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 174/352] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:23:24 2022] GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe => generated 1721 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:23:24.619954 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-2ef8dc50-9a28-4c17-bf51-5c2f57a79892 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:23:24.620578 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-2ef8dc50-9a28-4c17-bf51-5c2f57a79892 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 24ad6e3e-6043-4eff-afb4-0c6039e825fa] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:23:24.635889 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-2ef8dc50-9a28-4c17-bf51-5c2f57a79892 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:24.639409 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-2ef8dc50-9a28-4c17-bf51-5c2f57a79892 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:24.639905 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-2ef8dc50-9a28-4c17-bf51-5c2f57a79892 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:24.647290 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-2ef8dc50-9a28-4c17-bf51-5c2f57a79892 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:24.648145 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-2ef8dc50-9a28-4c17-bf51-5c2f57a79892 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:24.648262 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-2ef8dc50-9a28-4c17-bf51-5c2f57a79892 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:24.669429 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-936f22db-7345-4fee-87bc-1e1b4051d70d tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5cfee7994ab404d974d86d77e075209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33bb29688304d0dae3cfdc0eb54b7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:24.678530 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-936f22db-7345-4fee-87bc-1e1b4051d70d tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] 10.222.0.16 "GET /compute/v2.1/servers/fb16e6d4-57d8-4185-9955-ec1d261b365d" status: 200 len: 1260 microversion: 2.1 time: 0.424794 Oct 31 19:23:24.681899 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 179/353] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:23:24 2022] GET /compute/v2.1/servers/fb16e6d4-57d8-4185-9955-ec1d261b365d => generated 1260 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:23:25.267107 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-2ef8dc50-9a28-4c17-bf51-5c2f57a79892 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:25.277166 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-6a27e2ee-bcfc-4951-a98d-58031013ba4c tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:23:25.278001 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-6a27e2ee-bcfc-4951-a98d-58031013ba4c tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] [instance: ecd39339-b802-43f3-aba3-432fd6e5387e] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:23:25.279110 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-2ef8dc50-9a28-4c17-bf51-5c2f57a79892 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:25.282666 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-2ef8dc50-9a28-4c17-bf51-5c2f57a79892 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:25.283880 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-2ef8dc50-9a28-4c17-bf51-5c2f57a79892 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa" status: 200 len: 1740 microversion: 2.20 time: 0.669894 Oct 31 19:23:25.292973 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-6a27e2ee-bcfc-4951-a98d-58031013ba4c tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:25.293496 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-6a27e2ee-bcfc-4951-a98d-58031013ba4c tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:25.296098 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-6a27e2ee-bcfc-4951-a98d-58031013ba4c tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:25.296868 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-6a27e2ee-bcfc-4951-a98d-58031013ba4c tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:25.297389 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-6a27e2ee-bcfc-4951-a98d-58031013ba4c tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:25.297836 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-6a27e2ee-bcfc-4951-a98d-58031013ba4c tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:25.306241 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 175/354] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 31 19:23:24 2022] GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa => generated 1740 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 19:23:25.533774 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-0419c9a1-2e8e-4e7b-8139-f08672ab127d tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:23:25.534416 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-0419c9a1-2e8e-4e7b-8139-f08672ab127d tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] [instance: 0a122a08-bc0f-40fd-8139-74c9e8a70ebe] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:23:25.544562 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-0419c9a1-2e8e-4e7b-8139-f08672ab127d tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:25.545051 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-0419c9a1-2e8e-4e7b-8139-f08672ab127d tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:25.545483 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-0419c9a1-2e8e-4e7b-8139-f08672ab127d tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:25.558485 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-0419c9a1-2e8e-4e7b-8139-f08672ab127d tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:25.558986 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-0419c9a1-2e8e-4e7b-8139-f08672ab127d tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:25.559454 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-0419c9a1-2e8e-4e7b-8139-f08672ab127d tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:25.630173 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-6a27e2ee-bcfc-4951-a98d-58031013ba4c tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b652cca4b94e188b7362606edabb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47ae1789d284a72bb71a6ffe55e7d8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:25.643686 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-6a27e2ee-bcfc-4951-a98d-58031013ba4c tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] 10.222.0.16 "GET /compute/v2.1/servers/ecd39339-b802-43f3-aba3-432fd6e5387e" status: 200 len: 1358 microversion: 2.1 time: 0.371013 Oct 31 19:23:25.645435 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 180/355] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:23:25 2022] GET /compute/v2.1/servers/ecd39339-b802-43f3-aba3-432fd6e5387e => generated 1358 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 19:23:25.711574 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-ea432874-7c7d-430d-b4b4-7b9f866e97d7 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:23:25.713544 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-ea432874-7c7d-430d-b4b4-7b9f866e97d7 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] [instance: fb16e6d4-57d8-4185-9955-ec1d261b365d] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:23:25.726833 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-ea432874-7c7d-430d-b4b4-7b9f866e97d7 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:25.729388 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-ea432874-7c7d-430d-b4b4-7b9f866e97d7 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:25.731352 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-ea432874-7c7d-430d-b4b4-7b9f866e97d7 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:25.740280 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-ea432874-7c7d-430d-b4b4-7b9f866e97d7 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:25.743530 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-ea432874-7c7d-430d-b4b4-7b9f866e97d7 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:25.744263 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-ea432874-7c7d-430d-b4b4-7b9f866e97d7 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:25.759319 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG dbcounter [-] [118727] Writing DB stats nova_cell1:SELECT=100 {{(pid=118727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:23:25.897113 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-0419c9a1-2e8e-4e7b-8139-f08672ab127d tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ece6ca9374764214bac6263bd691bc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9c317b548b40deb8cb27236d36d674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:25.916391 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-0419c9a1-2e8e-4e7b-8139-f08672ab127d tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] 10.222.0.16 "GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe" status: 200 len: 1721 microversion: 2.1 time: 0.379629 Oct 31 19:23:25.926133 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 176/356] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:23:25 2022] GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe => generated 1721 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 19:23:26.058501 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-ea432874-7c7d-430d-b4b4-7b9f866e97d7 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5cfee7994ab404d974d86d77e075209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33bb29688304d0dae3cfdc0eb54b7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:26.068979 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-ea432874-7c7d-430d-b4b4-7b9f866e97d7 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] 10.222.0.16 "GET /compute/v2.1/servers/fb16e6d4-57d8-4185-9955-ec1d261b365d" status: 200 len: 1260 microversion: 2.1 time: 0.362233 Oct 31 19:23:26.072454 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 181/357] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:23:25 2022] GET /compute/v2.1/servers/fb16e6d4-57d8-4185-9955-ec1d261b365d => generated 1260 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:23:26.327615 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-1b10ed06-2407-495d-97d7-96048b90628c tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:23:26.332641 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [req-2c94d254-979c-4cf9-8cbf-51e51e2aae86 req-76581107-0057-4f62-b671-9a655a2a5a1f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3097dda0-1cb7-439c-b44a-898c488a6448", "tag": "47bfb5db-2a8e-49bb-8942-819d0c5b71da"}]} {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:23:26.335310 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-1b10ed06-2407-495d-97d7-96048b90628c tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 24ad6e3e-6043-4eff-afb4-0c6039e825fa] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:23:26.413642 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-1b10ed06-2407-495d-97d7-96048b90628c tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:26.442446 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-1b10ed06-2407-495d-97d7-96048b90628c tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.029s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:26.463662 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-1b10ed06-2407-495d-97d7-96048b90628c tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:26.468916 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-1b10ed06-2407-495d-97d7-96048b90628c tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:26.472687 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-1b10ed06-2407-495d-97d7-96048b90628c tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:26.475923 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [req-2c94d254-979c-4cf9-8cbf-51e51e2aae86 req-76581107-0057-4f62-b671-9a655a2a5a1f service nova] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:26.495313 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-1b10ed06-2407-495d-97d7-96048b90628c tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:26.500216 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [req-2c94d254-979c-4cf9-8cbf-51e51e2aae86 req-76581107-0057-4f62-b671-9a655a2a5a1f service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:26.501465 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [req-2c94d254-979c-4cf9-8cbf-51e51e2aae86 req-76581107-0057-4f62-b671-9a655a2a5a1f service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:26.521307 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.compute.server_external_events [req-2c94d254-979c-4cf9-8cbf-51e51e2aae86 req-76581107-0057-4f62-b671-9a655a2a5a1f service nova] Creating event network-changed:47bfb5db-2a8e-49bb-8942-819d0c5b71da for instance 3097dda0-1cb7-439c-b44a-898c488a6448 on hv-cinder-86309 Oct 31 19:23:26.528794 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [req-2c94d254-979c-4cf9-8cbf-51e51e2aae86 req-76581107-0057-4f62-b671-9a655a2a5a1f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.209234 Oct 31 19:23:26.529807 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 182/358] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 31 19:23:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:23:26.669767 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-8f98228d-6ee8-4d05-9a98-470eafb7ca26 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:23:26.670938 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-8f98228d-6ee8-4d05-9a98-470eafb7ca26 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] [instance: ecd39339-b802-43f3-aba3-432fd6e5387e] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:23:26.683686 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-8f98228d-6ee8-4d05-9a98-470eafb7ca26 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:26.686232 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-8f98228d-6ee8-4d05-9a98-470eafb7ca26 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:26.686993 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-8f98228d-6ee8-4d05-9a98-470eafb7ca26 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:26.690742 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-8f98228d-6ee8-4d05-9a98-470eafb7ca26 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:26.693523 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-8f98228d-6ee8-4d05-9a98-470eafb7ca26 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:26.694237 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-8f98228d-6ee8-4d05-9a98-470eafb7ca26 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:26.919580 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-1b10ed06-2407-495d-97d7-96048b90628c tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:26.936173 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-1b10ed06-2407-495d-97d7-96048b90628c tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:26.939819 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-1b10ed06-2407-495d-97d7-96048b90628c tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:26.945004 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-1b10ed06-2407-495d-97d7-96048b90628c tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa" status: 200 len: 1740 microversion: 2.20 time: 0.628562 Oct 31 19:23:26.947766 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 177/359] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 31 19:23:26 2022] GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa => generated 1740 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 19:23:26.989136 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-c5b19c67-693f-4d9e-956b-36a753ec1ceb tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:23:26.991135 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-c5b19c67-693f-4d9e-956b-36a753ec1ceb tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] [instance: 0a122a08-bc0f-40fd-8139-74c9e8a70ebe] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:23:27.001373 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-c5b19c67-693f-4d9e-956b-36a753ec1ceb tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:27.002152 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-c5b19c67-693f-4d9e-956b-36a753ec1ceb tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:27.003017 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-c5b19c67-693f-4d9e-956b-36a753ec1ceb tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:27.004939 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-c5b19c67-693f-4d9e-956b-36a753ec1ceb tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:27.006825 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-c5b19c67-693f-4d9e-956b-36a753ec1ceb tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:27.007866 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-c5b19c67-693f-4d9e-956b-36a753ec1ceb tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:27.243859 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-c5b19c67-693f-4d9e-956b-36a753ec1ceb tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ece6ca9374764214bac6263bd691bc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9c317b548b40deb8cb27236d36d674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:27.267097 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-c5b19c67-693f-4d9e-956b-36a753ec1ceb tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] 10.222.0.16 "GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe" status: 200 len: 1698 microversion: 2.1 time: 0.292861 Oct 31 19:23:27.268162 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 178/360] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:23:26 2022] GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe => generated 1698 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:23:27.298816 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-3f2b44fa-11fa-472e-8466-056780b83f49 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:23:27.300785 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-3f2b44fa-11fa-472e-8466-056780b83f49 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] [instance: fb16e6d4-57d8-4185-9955-ec1d261b365d] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:23:27.316948 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-3f2b44fa-11fa-472e-8466-056780b83f49 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:27.317439 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-3f2b44fa-11fa-472e-8466-056780b83f49 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:27.318003 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-3f2b44fa-11fa-472e-8466-056780b83f49 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:27.320135 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-3f2b44fa-11fa-472e-8466-056780b83f49 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:27.326387 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-3f2b44fa-11fa-472e-8466-056780b83f49 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:27.327169 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-3f2b44fa-11fa-472e-8466-056780b83f49 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:27.498032 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-8f98228d-6ee8-4d05-9a98-470eafb7ca26 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b652cca4b94e188b7362606edabb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47ae1789d284a72bb71a6ffe55e7d8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:27.528444 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-8f98228d-6ee8-4d05-9a98-470eafb7ca26 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] 10.222.0.16 "GET /compute/v2.1/servers/ecd39339-b802-43f3-aba3-432fd6e5387e" status: 200 len: 1358 microversion: 2.1 time: 0.860280 Oct 31 19:23:27.529317 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 183/361] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:23:26 2022] GET /compute/v2.1/servers/ecd39339-b802-43f3-aba3-432fd6e5387e => generated 1358 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:23:27.539370 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-23504f97-f442-4b29-b86c-a6b137d419ab tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:23:27.553326 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-23504f97-f442-4b29-b86c-a6b137d419ab tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:27.556083 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-23504f97-f442-4b29-b86c-a6b137d419ab tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:27.558054 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-23504f97-f442-4b29-b86c-a6b137d419ab tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:27.617008 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-23504f97-f442-4b29-b86c-a6b137d419ab tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] [instance: 0a122a08-bc0f-40fd-8139-74c9e8a70ebe] Going to try to start instance {{(pid=118727) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 31 19:23:27.652058 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-3f2b44fa-11fa-472e-8466-056780b83f49 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5cfee7994ab404d974d86d77e075209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33bb29688304d0dae3cfdc0eb54b7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:27.665963 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-3f2b44fa-11fa-472e-8466-056780b83f49 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] 10.222.0.16 "GET /compute/v2.1/servers/fb16e6d4-57d8-4185-9955-ec1d261b365d" status: 200 len: 1260 microversion: 2.1 time: 0.373673 Oct 31 19:23:27.668217 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 179/362] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:23:27 2022] GET /compute/v2.1/servers/fb16e6d4-57d8-4185-9955-ec1d261b365d => generated 1260 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:23:27.741705 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-23504f97-f442-4b29-b86c-a6b137d419ab tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] 10.222.0.16 "POST /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe/action" status: 202 len: 0 microversion: 2.1 time: 0.210881 Oct 31 19:23:27.750169 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 184/363] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 31 19:23:27 2022] POST /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe/action => generated 0 bytes in 218 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 19:23:27.757881 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-12c9cd12-626a-4471-8bb4-591413c0c749 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:23:27.758974 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-12c9cd12-626a-4471-8bb4-591413c0c749 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] [instance: 0a122a08-bc0f-40fd-8139-74c9e8a70ebe] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:23:27.802410 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-12c9cd12-626a-4471-8bb4-591413c0c749 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:27.805053 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-12c9cd12-626a-4471-8bb4-591413c0c749 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:27.812488 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-12c9cd12-626a-4471-8bb4-591413c0c749 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:27.816600 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-12c9cd12-626a-4471-8bb4-591413c0c749 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:27.817986 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-12c9cd12-626a-4471-8bb4-591413c0c749 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:27.822298 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-12c9cd12-626a-4471-8bb4-591413c0c749 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:27.979667 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-96eb7339-3941-49b0-b1d1-55dcd53b8184 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:23:27.980982 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-96eb7339-3941-49b0-b1d1-55dcd53b8184 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 24ad6e3e-6043-4eff-afb4-0c6039e825fa] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:23:27.992441 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-96eb7339-3941-49b0-b1d1-55dcd53b8184 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:27.992931 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-96eb7339-3941-49b0-b1d1-55dcd53b8184 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:27.993369 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-96eb7339-3941-49b0-b1d1-55dcd53b8184 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:27.994100 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-96eb7339-3941-49b0-b1d1-55dcd53b8184 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:27.994549 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-96eb7339-3941-49b0-b1d1-55dcd53b8184 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:27.994972 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-96eb7339-3941-49b0-b1d1-55dcd53b8184 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:28.423753 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-96eb7339-3941-49b0-b1d1-55dcd53b8184 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:28.436160 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-96eb7339-3941-49b0-b1d1-55dcd53b8184 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:28.437522 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-96eb7339-3941-49b0-b1d1-55dcd53b8184 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:28.439361 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-96eb7339-3941-49b0-b1d1-55dcd53b8184 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa" status: 200 len: 1740 microversion: 2.20 time: 0.464515 Oct 31 19:23:28.453951 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 185/364] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 31 19:23:27 2022] GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa => generated 1740 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 19:23:28.561748 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-86a4cec8-ceb5-4163-92f6-c8fa89ef9e38 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:23:28.562533 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-86a4cec8-ceb5-4163-92f6-c8fa89ef9e38 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] [instance: ecd39339-b802-43f3-aba3-432fd6e5387e] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:23:28.577546 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-86a4cec8-ceb5-4163-92f6-c8fa89ef9e38 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:28.578971 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-86a4cec8-ceb5-4163-92f6-c8fa89ef9e38 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:28.579524 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-86a4cec8-ceb5-4163-92f6-c8fa89ef9e38 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:28.580364 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-86a4cec8-ceb5-4163-92f6-c8fa89ef9e38 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:28.580926 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-86a4cec8-ceb5-4163-92f6-c8fa89ef9e38 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:28.581446 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-86a4cec8-ceb5-4163-92f6-c8fa89ef9e38 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:28.945991 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-86a4cec8-ceb5-4163-92f6-c8fa89ef9e38 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b652cca4b94e188b7362606edabb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47ae1789d284a72bb71a6ffe55e7d8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:28.971152 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-86a4cec8-ceb5-4163-92f6-c8fa89ef9e38 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] 10.222.0.16 "GET /compute/v2.1/servers/ecd39339-b802-43f3-aba3-432fd6e5387e" status: 200 len: 1358 microversion: 2.1 time: 0.416547 Oct 31 19:23:28.972952 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 186/365] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:23:28 2022] GET /compute/v2.1/servers/ecd39339-b802-43f3-aba3-432fd6e5387e => generated 1358 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 19:23:28.979720 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-6ec605df-c464-427a-a665-b2d8f75f6ccf tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:23:28.980587 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-6ec605df-c464-427a-a665-b2d8f75f6ccf tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] [instance: fb16e6d4-57d8-4185-9955-ec1d261b365d] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:23:29.002198 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-6ec605df-c464-427a-a665-b2d8f75f6ccf tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:29.006314 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-6ec605df-c464-427a-a665-b2d8f75f6ccf tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:29.006986 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-6ec605df-c464-427a-a665-b2d8f75f6ccf tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:29.012053 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-6ec605df-c464-427a-a665-b2d8f75f6ccf tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:29.013148 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-6ec605df-c464-427a-a665-b2d8f75f6ccf tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:29.014808 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-6ec605df-c464-427a-a665-b2d8f75f6ccf tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:29.124925 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-12c9cd12-626a-4471-8bb4-591413c0c749 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ece6ca9374764214bac6263bd691bc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9c317b548b40deb8cb27236d36d674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:29.158550 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-12c9cd12-626a-4471-8bb4-591413c0c749 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] 10.222.0.16 "GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe" status: 200 len: 1707 microversion: 2.1 time: 1.402505 Oct 31 19:23:29.159213 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 180/366] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:23:27 2022] GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe => generated 1707 bytes in 1407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:23:29.439818 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-6ec605df-c464-427a-a665-b2d8f75f6ccf tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5cfee7994ab404d974d86d77e075209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33bb29688304d0dae3cfdc0eb54b7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:29.454359 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-6ec605df-c464-427a-a665-b2d8f75f6ccf tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] 10.222.0.16 "GET /compute/v2.1/servers/fb16e6d4-57d8-4185-9955-ec1d261b365d" status: 200 len: 1260 microversion: 2.1 time: 0.479619 Oct 31 19:23:29.454966 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 187/367] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:23:28 2022] GET /compute/v2.1/servers/fb16e6d4-57d8-4185-9955-ec1d261b365d => generated 1260 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:23:29.470546 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-97449902-ad71-4082-85bc-fe13ba8a7535 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:23:29.471398 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-97449902-ad71-4082-85bc-fe13ba8a7535 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 24ad6e3e-6043-4eff-afb4-0c6039e825fa] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:23:29.482086 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-97449902-ad71-4082-85bc-fe13ba8a7535 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:29.485652 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-97449902-ad71-4082-85bc-fe13ba8a7535 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:29.486342 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-97449902-ad71-4082-85bc-fe13ba8a7535 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:29.487239 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-97449902-ad71-4082-85bc-fe13ba8a7535 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:29.497116 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-97449902-ad71-4082-85bc-fe13ba8a7535 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:29.497548 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-97449902-ad71-4082-85bc-fe13ba8a7535 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:29.940012 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-97449902-ad71-4082-85bc-fe13ba8a7535 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:29.955614 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-97449902-ad71-4082-85bc-fe13ba8a7535 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:29.975337 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-97449902-ad71-4082-85bc-fe13ba8a7535 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:29.976643 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-97449902-ad71-4082-85bc-fe13ba8a7535 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa" status: 200 len: 1740 microversion: 2.20 time: 0.509979 Oct 31 19:23:29.977645 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 181/368] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 31 19:23:29 2022] GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa => generated 1740 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 19:23:30.003906 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-4e94e0fe-706f-436c-ad6a-8d7c7f221cec tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:23:30.004606 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-4e94e0fe-706f-436c-ad6a-8d7c7f221cec tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] [instance: ecd39339-b802-43f3-aba3-432fd6e5387e] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:23:30.026032 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-4e94e0fe-706f-436c-ad6a-8d7c7f221cec tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:30.026466 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-4e94e0fe-706f-436c-ad6a-8d7c7f221cec tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:30.026904 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-4e94e0fe-706f-436c-ad6a-8d7c7f221cec tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:30.027613 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-4e94e0fe-706f-436c-ad6a-8d7c7f221cec tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:30.028068 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-4e94e0fe-706f-436c-ad6a-8d7c7f221cec tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:30.028491 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-4e94e0fe-706f-436c-ad6a-8d7c7f221cec tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:30.187351 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-b54be7e8-1770-40aa-bd6f-3bdc9ebf98b1 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:23:30.187995 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-b54be7e8-1770-40aa-bd6f-3bdc9ebf98b1 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] [instance: 0a122a08-bc0f-40fd-8139-74c9e8a70ebe] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:23:30.202764 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-b54be7e8-1770-40aa-bd6f-3bdc9ebf98b1 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:30.206248 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-b54be7e8-1770-40aa-bd6f-3bdc9ebf98b1 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:30.206955 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-b54be7e8-1770-40aa-bd6f-3bdc9ebf98b1 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:30.207963 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-b54be7e8-1770-40aa-bd6f-3bdc9ebf98b1 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:30.209038 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-b54be7e8-1770-40aa-bd6f-3bdc9ebf98b1 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:30.211902 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-b54be7e8-1770-40aa-bd6f-3bdc9ebf98b1 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:30.381541 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-4e94e0fe-706f-436c-ad6a-8d7c7f221cec tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b652cca4b94e188b7362606edabb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47ae1789d284a72bb71a6ffe55e7d8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:30.397973 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-4e94e0fe-706f-436c-ad6a-8d7c7f221cec tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] 10.222.0.16 "GET /compute/v2.1/servers/ecd39339-b802-43f3-aba3-432fd6e5387e" status: 200 len: 1358 microversion: 2.1 time: 0.394793 Oct 31 19:23:30.407550 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 188/369] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:23:29 2022] GET /compute/v2.1/servers/ecd39339-b802-43f3-aba3-432fd6e5387e => generated 1358 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:23:30.483244 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-1d259df4-1e8c-452b-b420-69fb2200527f tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:23:30.484120 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-1d259df4-1e8c-452b-b420-69fb2200527f tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] [instance: fb16e6d4-57d8-4185-9955-ec1d261b365d] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:23:30.490734 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-1d259df4-1e8c-452b-b420-69fb2200527f tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:30.491347 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-1d259df4-1e8c-452b-b420-69fb2200527f tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:30.492048 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-1d259df4-1e8c-452b-b420-69fb2200527f tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:30.492987 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-1d259df4-1e8c-452b-b420-69fb2200527f tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:30.493807 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-1d259df4-1e8c-452b-b420-69fb2200527f tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:30.494630 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-1d259df4-1e8c-452b-b420-69fb2200527f tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:30.533936 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-b54be7e8-1770-40aa-bd6f-3bdc9ebf98b1 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ece6ca9374764214bac6263bd691bc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9c317b548b40deb8cb27236d36d674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:30.551948 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-b54be7e8-1770-40aa-bd6f-3bdc9ebf98b1 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] 10.222.0.16 "GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe" status: 200 len: 1707 microversion: 2.1 time: 0.367786 Oct 31 19:23:30.570761 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 182/370] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:23:30 2022] GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe => generated 1707 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:23:30.675093 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-1d259df4-1e8c-452b-b420-69fb2200527f tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5cfee7994ab404d974d86d77e075209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33bb29688304d0dae3cfdc0eb54b7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:30.685563 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-1d259df4-1e8c-452b-b420-69fb2200527f tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] 10.222.0.16 "GET /compute/v2.1/servers/fb16e6d4-57d8-4185-9955-ec1d261b365d" status: 200 len: 1260 microversion: 2.1 time: 0.206056 Oct 31 19:23:30.686545 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 189/371] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:23:30 2022] GET /compute/v2.1/servers/fb16e6d4-57d8-4185-9955-ec1d261b365d => generated 1260 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:23:31.007188 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-62cc8a87-d975-4b5e-abac-6caea8ff6dc8 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:23:31.007811 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-62cc8a87-d975-4b5e-abac-6caea8ff6dc8 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 24ad6e3e-6043-4eff-afb4-0c6039e825fa] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:23:31.014296 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-62cc8a87-d975-4b5e-abac-6caea8ff6dc8 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:31.014794 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-62cc8a87-d975-4b5e-abac-6caea8ff6dc8 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:31.015219 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-62cc8a87-d975-4b5e-abac-6caea8ff6dc8 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:31.015958 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-62cc8a87-d975-4b5e-abac-6caea8ff6dc8 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:31.016413 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-62cc8a87-d975-4b5e-abac-6caea8ff6dc8 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:31.016838 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-62cc8a87-d975-4b5e-abac-6caea8ff6dc8 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:31.179958 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-62cc8a87-d975-4b5e-abac-6caea8ff6dc8 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:31.189383 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-62cc8a87-d975-4b5e-abac-6caea8ff6dc8 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:31.192498 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-62cc8a87-d975-4b5e-abac-6caea8ff6dc8 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:31.193883 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-62cc8a87-d975-4b5e-abac-6caea8ff6dc8 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa" status: 200 len: 1740 microversion: 2.20 time: 0.191142 Oct 31 19:23:31.194601 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 183/372] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 31 19:23:31 2022] GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa => generated 1740 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 19:23:31.415524 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-1c71d9a2-c4c6-4969-a1ae-77242b1f212f tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:23:31.418796 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-1c71d9a2-c4c6-4969-a1ae-77242b1f212f tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] [instance: ecd39339-b802-43f3-aba3-432fd6e5387e] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:23:31.428169 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-1c71d9a2-c4c6-4969-a1ae-77242b1f212f tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:31.428676 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-1c71d9a2-c4c6-4969-a1ae-77242b1f212f tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:31.429122 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-1c71d9a2-c4c6-4969-a1ae-77242b1f212f tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:31.429860 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-1c71d9a2-c4c6-4969-a1ae-77242b1f212f tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:31.430328 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-1c71d9a2-c4c6-4969-a1ae-77242b1f212f tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:31.430755 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-1c71d9a2-c4c6-4969-a1ae-77242b1f212f tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:31.581432 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-d3bde9ca-df7b-4f6e-9fc0-a1b0738d5af1 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:23:31.582392 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-d3bde9ca-df7b-4f6e-9fc0-a1b0738d5af1 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] [instance: 0a122a08-bc0f-40fd-8139-74c9e8a70ebe] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:23:31.596325 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-d3bde9ca-df7b-4f6e-9fc0-a1b0738d5af1 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:31.597883 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-d3bde9ca-df7b-4f6e-9fc0-a1b0738d5af1 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:31.599562 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-d3bde9ca-df7b-4f6e-9fc0-a1b0738d5af1 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:31.600530 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-d3bde9ca-df7b-4f6e-9fc0-a1b0738d5af1 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:31.602960 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-d3bde9ca-df7b-4f6e-9fc0-a1b0738d5af1 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:31.604150 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-d3bde9ca-df7b-4f6e-9fc0-a1b0738d5af1 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:31.679681 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-1c71d9a2-c4c6-4969-a1ae-77242b1f212f tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b652cca4b94e188b7362606edabb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47ae1789d284a72bb71a6ffe55e7d8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:31.690894 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-1c71d9a2-c4c6-4969-a1ae-77242b1f212f tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] 10.222.0.16 "GET /compute/v2.1/servers/ecd39339-b802-43f3-aba3-432fd6e5387e" status: 200 len: 1358 microversion: 2.1 time: 0.279118 Oct 31 19:23:31.691972 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 190/373] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:23:31 2022] GET /compute/v2.1/servers/ecd39339-b802-43f3-aba3-432fd6e5387e => generated 1358 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:23:31.731048 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-9ae70df6-1403-4a54-8760-191968d9873c tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:23:31.732016 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-9ae70df6-1403-4a54-8760-191968d9873c tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] [instance: fb16e6d4-57d8-4185-9955-ec1d261b365d] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:23:31.743354 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-9ae70df6-1403-4a54-8760-191968d9873c tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:31.744751 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-9ae70df6-1403-4a54-8760-191968d9873c tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:31.745714 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-9ae70df6-1403-4a54-8760-191968d9873c tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:31.747156 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-9ae70df6-1403-4a54-8760-191968d9873c tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:31.748081 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-9ae70df6-1403-4a54-8760-191968d9873c tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:31.749038 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-9ae70df6-1403-4a54-8760-191968d9873c tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:31.955064 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-d3bde9ca-df7b-4f6e-9fc0-a1b0738d5af1 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ece6ca9374764214bac6263bd691bc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9c317b548b40deb8cb27236d36d674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:31.996803 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-d3bde9ca-df7b-4f6e-9fc0-a1b0738d5af1 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] 10.222.0.16 "GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe" status: 200 len: 1707 microversion: 2.1 time: 0.415482 Oct 31 19:23:32.000695 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 184/374] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:23:31 2022] GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe => generated 1707 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:23:32.015941 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [req-d7afc18d-56b0-4788-a9b3-9f91b82a88dd req-9c4c60ff-18a2-4b34-944a-a2429fa3b52a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb16e6d4-57d8-4185-9955-ec1d261b365d", "name": "network-vif-plugged", "status": "completed", "tag": "d4d5c6c7-d643-4ff8-859d-8b480d999f74"}]} {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:23:32.063907 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-9ae70df6-1403-4a54-8760-191968d9873c tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5cfee7994ab404d974d86d77e075209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33bb29688304d0dae3cfdc0eb54b7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:32.066653 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [req-d7afc18d-56b0-4788-a9b3-9f91b82a88dd req-9c4c60ff-18a2-4b34-944a-a2429fa3b52a service nova] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:32.078744 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [req-d7afc18d-56b0-4788-a9b3-9f91b82a88dd req-9c4c60ff-18a2-4b34-944a-a2429fa3b52a service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:32.079713 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [req-d7afc18d-56b0-4788-a9b3-9f91b82a88dd req-9c4c60ff-18a2-4b34-944a-a2429fa3b52a service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:32.082326 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-9ae70df6-1403-4a54-8760-191968d9873c tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] 10.222.0.16 "GET /compute/v2.1/servers/fb16e6d4-57d8-4185-9955-ec1d261b365d" status: 200 len: 1260 microversion: 2.1 time: 0.355338 Oct 31 19:23:32.082934 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 191/375] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:23:31 2022] GET /compute/v2.1/servers/fb16e6d4-57d8-4185-9955-ec1d261b365d => generated 1260 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:23:32.112524 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.compute.server_external_events [req-d7afc18d-56b0-4788-a9b3-9f91b82a88dd req-9c4c60ff-18a2-4b34-944a-a2429fa3b52a service nova] Creating event network-vif-plugged:d4d5c6c7-d643-4ff8-859d-8b480d999f74 for instance fb16e6d4-57d8-4185-9955-ec1d261b365d on hv-cinder-86309 Oct 31 19:23:32.118561 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [req-d7afc18d-56b0-4788-a9b3-9f91b82a88dd req-9c4c60ff-18a2-4b34-944a-a2429fa3b52a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110799 Oct 31 19:23:32.119500 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 185/376] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 31 19:23:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:23:32.224454 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-114b9af6-4cea-4840-b341-23ef1c9a2002 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:23:32.229669 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-114b9af6-4cea-4840-b341-23ef1c9a2002 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 24ad6e3e-6043-4eff-afb4-0c6039e825fa] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:23:32.243339 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-114b9af6-4cea-4840-b341-23ef1c9a2002 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:32.246255 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-114b9af6-4cea-4840-b341-23ef1c9a2002 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:32.248426 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-114b9af6-4cea-4840-b341-23ef1c9a2002 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:32.250620 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-114b9af6-4cea-4840-b341-23ef1c9a2002 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:32.251502 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-114b9af6-4cea-4840-b341-23ef1c9a2002 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:32.254338 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-114b9af6-4cea-4840-b341-23ef1c9a2002 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:32.530869 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-114b9af6-4cea-4840-b341-23ef1c9a2002 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:32.548575 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-114b9af6-4cea-4840-b341-23ef1c9a2002 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:32.551819 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-114b9af6-4cea-4840-b341-23ef1c9a2002 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:32.555265 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-114b9af6-4cea-4840-b341-23ef1c9a2002 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa" status: 200 len: 1740 microversion: 2.20 time: 0.336513 Oct 31 19:23:32.556155 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 192/377] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 31 19:23:32 2022] GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa => generated 1740 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 19:23:32.716880 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-215b5de3-a15d-404b-af06-c4d2687c31cd tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:23:32.717594 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-215b5de3-a15d-404b-af06-c4d2687c31cd tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] [instance: ecd39339-b802-43f3-aba3-432fd6e5387e] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:23:32.723928 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-215b5de3-a15d-404b-af06-c4d2687c31cd tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:32.724411 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-215b5de3-a15d-404b-af06-c4d2687c31cd tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:32.724895 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-215b5de3-a15d-404b-af06-c4d2687c31cd tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:32.725533 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-215b5de3-a15d-404b-af06-c4d2687c31cd tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:32.726054 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-215b5de3-a15d-404b-af06-c4d2687c31cd tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:32.726481 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-215b5de3-a15d-404b-af06-c4d2687c31cd tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:32.886845 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-215b5de3-a15d-404b-af06-c4d2687c31cd tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b652cca4b94e188b7362606edabb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47ae1789d284a72bb71a6ffe55e7d8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:32.897092 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-215b5de3-a15d-404b-af06-c4d2687c31cd tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] 10.222.0.16 "GET /compute/v2.1/servers/ecd39339-b802-43f3-aba3-432fd6e5387e" status: 200 len: 1358 microversion: 2.1 time: 0.184421 Oct 31 19:23:32.898137 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 186/378] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:23:32 2022] GET /compute/v2.1/servers/ecd39339-b802-43f3-aba3-432fd6e5387e => generated 1358 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:23:33.031582 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-ba0ae68a-37af-4bd9-a1a1-db9d108429eb tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:23:33.032304 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-ba0ae68a-37af-4bd9-a1a1-db9d108429eb tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] [instance: 0a122a08-bc0f-40fd-8139-74c9e8a70ebe] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:23:33.038525 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-ba0ae68a-37af-4bd9-a1a1-db9d108429eb tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:33.039121 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-ba0ae68a-37af-4bd9-a1a1-db9d108429eb tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:33.039813 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-ba0ae68a-37af-4bd9-a1a1-db9d108429eb tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:33.040831 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-ba0ae68a-37af-4bd9-a1a1-db9d108429eb tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:33.041500 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-ba0ae68a-37af-4bd9-a1a1-db9d108429eb tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:33.042420 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-ba0ae68a-37af-4bd9-a1a1-db9d108429eb tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:33.108205 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-e052b532-e260-4275-9873-29017e844e3c tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:23:33.108825 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-e052b532-e260-4275-9873-29017e844e3c tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] [instance: fb16e6d4-57d8-4185-9955-ec1d261b365d] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:23:33.115933 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-e052b532-e260-4275-9873-29017e844e3c tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:33.116681 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-e052b532-e260-4275-9873-29017e844e3c tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:33.117290 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-e052b532-e260-4275-9873-29017e844e3c tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:33.118238 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-e052b532-e260-4275-9873-29017e844e3c tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:33.118938 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-e052b532-e260-4275-9873-29017e844e3c tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:33.119376 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-e052b532-e260-4275-9873-29017e844e3c tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:33.222045 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-ba0ae68a-37af-4bd9-a1a1-db9d108429eb tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ece6ca9374764214bac6263bd691bc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9c317b548b40deb8cb27236d36d674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:33.231739 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-ba0ae68a-37af-4bd9-a1a1-db9d108429eb tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] 10.222.0.16 "GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe" status: 200 len: 1707 microversion: 2.1 time: 0.203921 Oct 31 19:23:33.245882 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 193/379] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:23:33 2022] GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe => generated 1707 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:23:33.291904 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-e052b532-e260-4275-9873-29017e844e3c tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5cfee7994ab404d974d86d77e075209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33bb29688304d0dae3cfdc0eb54b7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:33.300097 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-e052b532-e260-4275-9873-29017e844e3c tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] 10.222.0.16 "GET /compute/v2.1/servers/fb16e6d4-57d8-4185-9955-ec1d261b365d" status: 200 len: 1260 microversion: 2.1 time: 0.195697 Oct 31 19:23:33.300655 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 187/380] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:23:33 2022] GET /compute/v2.1/servers/fb16e6d4-57d8-4185-9955-ec1d261b365d => generated 1260 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 19:23:33.586636 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-e0b072d6-57ee-4d5c-8878-fcb269359f82 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:23:33.587327 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-e0b072d6-57ee-4d5c-8878-fcb269359f82 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 24ad6e3e-6043-4eff-afb4-0c6039e825fa] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:23:33.593780 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-e0b072d6-57ee-4d5c-8878-fcb269359f82 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:33.594376 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-e0b072d6-57ee-4d5c-8878-fcb269359f82 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:33.594876 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-e0b072d6-57ee-4d5c-8878-fcb269359f82 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:33.595674 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-e0b072d6-57ee-4d5c-8878-fcb269359f82 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:33.596245 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-e0b072d6-57ee-4d5c-8878-fcb269359f82 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:33.596685 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-e0b072d6-57ee-4d5c-8878-fcb269359f82 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:33.763239 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-e0b072d6-57ee-4d5c-8878-fcb269359f82 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:33.772477 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-e0b072d6-57ee-4d5c-8878-fcb269359f82 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:33.774604 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-e0b072d6-57ee-4d5c-8878-fcb269359f82 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:33.776052 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-e0b072d6-57ee-4d5c-8878-fcb269359f82 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa" status: 200 len: 1740 microversion: 2.20 time: 0.193566 Oct 31 19:23:33.776998 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 194/381] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 31 19:23:33 2022] GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa => generated 1740 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 19:23:33.923342 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-625199f6-362b-42d4-aee2-e81f7c9fbc13 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:23:33.924048 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-625199f6-362b-42d4-aee2-e81f7c9fbc13 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] [instance: ecd39339-b802-43f3-aba3-432fd6e5387e] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:23:33.939651 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-625199f6-362b-42d4-aee2-e81f7c9fbc13 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:33.940619 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-625199f6-362b-42d4-aee2-e81f7c9fbc13 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:33.941427 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-625199f6-362b-42d4-aee2-e81f7c9fbc13 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:33.942297 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-625199f6-362b-42d4-aee2-e81f7c9fbc13 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:33.947528 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-625199f6-362b-42d4-aee2-e81f7c9fbc13 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:33.953297 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-625199f6-362b-42d4-aee2-e81f7c9fbc13 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:34.108596 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-625199f6-362b-42d4-aee2-e81f7c9fbc13 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b652cca4b94e188b7362606edabb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47ae1789d284a72bb71a6ffe55e7d8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:34.116866 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-625199f6-362b-42d4-aee2-e81f7c9fbc13 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] 10.222.0.16 "GET /compute/v2.1/servers/ecd39339-b802-43f3-aba3-432fd6e5387e" status: 200 len: 1358 microversion: 2.1 time: 0.200337 Oct 31 19:23:34.117421 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 188/382] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:23:33 2022] GET /compute/v2.1/servers/ecd39339-b802-43f3-aba3-432fd6e5387e => generated 1358 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:23:34.256180 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-0ec89454-45e7-41f0-aa02-8963df06cee5 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:23:34.256789 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-0ec89454-45e7-41f0-aa02-8963df06cee5 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] [instance: 0a122a08-bc0f-40fd-8139-74c9e8a70ebe] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:23:34.258814 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG dbcounter [-] [118727] Writing DB stats nova_api:SELECT=100 {{(pid=118727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:23:34.264038 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-0ec89454-45e7-41f0-aa02-8963df06cee5 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:34.264519 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-0ec89454-45e7-41f0-aa02-8963df06cee5 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:34.264950 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-0ec89454-45e7-41f0-aa02-8963df06cee5 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:34.265661 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-0ec89454-45e7-41f0-aa02-8963df06cee5 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:34.266119 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-0ec89454-45e7-41f0-aa02-8963df06cee5 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:34.266543 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-0ec89454-45e7-41f0-aa02-8963df06cee5 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:34.323073 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-4299f9a6-4b43-4172-bbcb-d1ece509ec75 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:23:34.323987 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-4299f9a6-4b43-4172-bbcb-d1ece509ec75 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] [instance: fb16e6d4-57d8-4185-9955-ec1d261b365d] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:23:34.330100 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-4299f9a6-4b43-4172-bbcb-d1ece509ec75 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:34.330722 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-4299f9a6-4b43-4172-bbcb-d1ece509ec75 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:34.331155 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-4299f9a6-4b43-4172-bbcb-d1ece509ec75 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:34.331886 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-4299f9a6-4b43-4172-bbcb-d1ece509ec75 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:34.332329 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-4299f9a6-4b43-4172-bbcb-d1ece509ec75 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:34.332748 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-4299f9a6-4b43-4172-bbcb-d1ece509ec75 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:34.396976 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-0ec89454-45e7-41f0-aa02-8963df06cee5 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ece6ca9374764214bac6263bd691bc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9c317b548b40deb8cb27236d36d674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:34.405468 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-0ec89454-45e7-41f0-aa02-8963df06cee5 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] 10.222.0.16 "GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe" status: 200 len: 1707 microversion: 2.1 time: 0.153373 Oct 31 19:23:34.407161 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 195/383] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:23:34 2022] GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe => generated 1707 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:23:34.465298 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-4299f9a6-4b43-4172-bbcb-d1ece509ec75 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5cfee7994ab404d974d86d77e075209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33bb29688304d0dae3cfdc0eb54b7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:34.473598 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-4299f9a6-4b43-4172-bbcb-d1ece509ec75 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] 10.222.0.16 "GET /compute/v2.1/servers/fb16e6d4-57d8-4185-9955-ec1d261b365d" status: 200 len: 1260 microversion: 2.1 time: 0.154345 Oct 31 19:23:34.474679 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 189/384] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:23:34 2022] GET /compute/v2.1/servers/fb16e6d4-57d8-4185-9955-ec1d261b365d => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 19:23:34.808840 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-0ffa652b-c650-47fe-9383-97aa3f4f1fe9 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:23:34.809583 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-0ffa652b-c650-47fe-9383-97aa3f4f1fe9 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 24ad6e3e-6043-4eff-afb4-0c6039e825fa] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:23:34.816582 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-0ffa652b-c650-47fe-9383-97aa3f4f1fe9 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:34.817233 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-0ffa652b-c650-47fe-9383-97aa3f4f1fe9 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:34.817798 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-0ffa652b-c650-47fe-9383-97aa3f4f1fe9 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:34.818499 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-0ffa652b-c650-47fe-9383-97aa3f4f1fe9 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:34.818957 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-0ffa652b-c650-47fe-9383-97aa3f4f1fe9 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:34.819516 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-0ffa652b-c650-47fe-9383-97aa3f4f1fe9 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:34.945854 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-0ffa652b-c650-47fe-9383-97aa3f4f1fe9 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:34.953883 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-0ffa652b-c650-47fe-9383-97aa3f4f1fe9 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:34.955320 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-0ffa652b-c650-47fe-9383-97aa3f4f1fe9 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:34.956459 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-0ffa652b-c650-47fe-9383-97aa3f4f1fe9 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa" status: 200 len: 1740 microversion: 2.20 time: 0.152065 Oct 31 19:23:34.957019 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 196/385] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 31 19:23:34 2022] GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa => generated 1740 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 19:23:35.139622 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-4a9a6108-dd34-4367-8791-a5ce19b62b88 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:23:35.140226 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-4a9a6108-dd34-4367-8791-a5ce19b62b88 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] [instance: ecd39339-b802-43f3-aba3-432fd6e5387e] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:23:35.153972 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-4a9a6108-dd34-4367-8791-a5ce19b62b88 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:35.153972 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-4a9a6108-dd34-4367-8791-a5ce19b62b88 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:35.153972 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-4a9a6108-dd34-4367-8791-a5ce19b62b88 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:35.153972 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-4a9a6108-dd34-4367-8791-a5ce19b62b88 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:35.154314 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-4a9a6108-dd34-4367-8791-a5ce19b62b88 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:35.154314 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-4a9a6108-dd34-4367-8791-a5ce19b62b88 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:35.297835 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-4a9a6108-dd34-4367-8791-a5ce19b62b88 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b652cca4b94e188b7362606edabb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47ae1789d284a72bb71a6ffe55e7d8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:35.305391 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-4a9a6108-dd34-4367-8791-a5ce19b62b88 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] 10.222.0.16 "GET /compute/v2.1/servers/ecd39339-b802-43f3-aba3-432fd6e5387e" status: 200 len: 1358 microversion: 2.1 time: 0.169539 Oct 31 19:23:35.306079 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 190/386] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:23:35 2022] GET /compute/v2.1/servers/ecd39339-b802-43f3-aba3-432fd6e5387e => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:23:35.430093 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-3a1365db-2177-4437-8b02-42d529a1ba99 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:23:35.430809 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-3a1365db-2177-4437-8b02-42d529a1ba99 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] [instance: 0a122a08-bc0f-40fd-8139-74c9e8a70ebe] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:23:35.438540 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-3a1365db-2177-4437-8b02-42d529a1ba99 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:35.438872 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-3a1365db-2177-4437-8b02-42d529a1ba99 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:35.439574 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-3a1365db-2177-4437-8b02-42d529a1ba99 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:35.440537 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-3a1365db-2177-4437-8b02-42d529a1ba99 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:35.441101 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-3a1365db-2177-4437-8b02-42d529a1ba99 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:35.441817 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-3a1365db-2177-4437-8b02-42d529a1ba99 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:35.457797 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG dbcounter [-] [118727] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:23:35.496585 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-4dc1acb4-a2e7-4c67-8b46-cdc93824a1e5 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:23:35.497184 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-4dc1acb4-a2e7-4c67-8b46-cdc93824a1e5 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] [instance: fb16e6d4-57d8-4185-9955-ec1d261b365d] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:23:35.503370 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-4dc1acb4-a2e7-4c67-8b46-cdc93824a1e5 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:35.503854 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-4dc1acb4-a2e7-4c67-8b46-cdc93824a1e5 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:35.504278 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-4dc1acb4-a2e7-4c67-8b46-cdc93824a1e5 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:35.505188 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-4dc1acb4-a2e7-4c67-8b46-cdc93824a1e5 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:35.505891 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-4dc1acb4-a2e7-4c67-8b46-cdc93824a1e5 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:35.506312 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-4dc1acb4-a2e7-4c67-8b46-cdc93824a1e5 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:35.585585 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-3a1365db-2177-4437-8b02-42d529a1ba99 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ece6ca9374764214bac6263bd691bc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9c317b548b40deb8cb27236d36d674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:35.594453 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-3a1365db-2177-4437-8b02-42d529a1ba99 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] 10.222.0.16 "GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe" status: 200 len: 1711 microversion: 2.1 time: 0.168654 Oct 31 19:23:35.595034 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 197/387] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:23:35 2022] GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe => generated 1711 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:23:35.642051 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-4dc1acb4-a2e7-4c67-8b46-cdc93824a1e5 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5cfee7994ab404d974d86d77e075209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33bb29688304d0dae3cfdc0eb54b7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:35.649805 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-4dc1acb4-a2e7-4c67-8b46-cdc93824a1e5 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] 10.222.0.16 "GET /compute/v2.1/servers/fb16e6d4-57d8-4185-9955-ec1d261b365d" status: 200 len: 1260 microversion: 2.1 time: 0.157110 Oct 31 19:23:35.650517 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 191/388] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:23:35 2022] GET /compute/v2.1/servers/fb16e6d4-57d8-4185-9955-ec1d261b365d => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 19:23:35.982100 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-c2314a22-a9f7-4789-b46a-b87ad62ab625 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:23:35.982620 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-c2314a22-a9f7-4789-b46a-b87ad62ab625 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 24ad6e3e-6043-4eff-afb4-0c6039e825fa] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:23:35.989503 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-c2314a22-a9f7-4789-b46a-b87ad62ab625 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:35.990043 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-c2314a22-a9f7-4789-b46a-b87ad62ab625 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:35.990480 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-c2314a22-a9f7-4789-b46a-b87ad62ab625 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:35.991165 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-c2314a22-a9f7-4789-b46a-b87ad62ab625 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:35.991620 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-c2314a22-a9f7-4789-b46a-b87ad62ab625 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:35.992044 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-c2314a22-a9f7-4789-b46a-b87ad62ab625 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:36.123636 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-c2314a22-a9f7-4789-b46a-b87ad62ab625 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:36.132536 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-c2314a22-a9f7-4789-b46a-b87ad62ab625 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:36.134037 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-c2314a22-a9f7-4789-b46a-b87ad62ab625 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:36.135200 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-c2314a22-a9f7-4789-b46a-b87ad62ab625 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa" status: 200 len: 1722 microversion: 2.20 time: 0.157090 Oct 31 19:23:36.135764 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 198/389] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 31 19:23:35 2022] GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 19:23:36.327709 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-a6fd405f-07b2-4af6-8cde-737bae1476f8 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:23:36.328397 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-a6fd405f-07b2-4af6-8cde-737bae1476f8 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] [instance: ecd39339-b802-43f3-aba3-432fd6e5387e] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:23:36.334971 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-a6fd405f-07b2-4af6-8cde-737bae1476f8 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:36.335483 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-a6fd405f-07b2-4af6-8cde-737bae1476f8 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:36.335964 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-a6fd405f-07b2-4af6-8cde-737bae1476f8 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:36.336720 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-a6fd405f-07b2-4af6-8cde-737bae1476f8 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:36.337236 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-a6fd405f-07b2-4af6-8cde-737bae1476f8 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:36.337725 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-a6fd405f-07b2-4af6-8cde-737bae1476f8 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:36.341916 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG dbcounter [-] [118726] Writing DB stats nova_cell1:SELECT=100 {{(pid=118726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:23:36.473802 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-a6fd405f-07b2-4af6-8cde-737bae1476f8 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b652cca4b94e188b7362606edabb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47ae1789d284a72bb71a6ffe55e7d8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:36.482663 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-a6fd405f-07b2-4af6-8cde-737bae1476f8 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] 10.222.0.16 "GET /compute/v2.1/servers/ecd39339-b802-43f3-aba3-432fd6e5387e" status: 200 len: 1358 microversion: 2.1 time: 0.158874 Oct 31 19:23:36.483129 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 192/390] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:23:36 2022] GET /compute/v2.1/servers/ecd39339-b802-43f3-aba3-432fd6e5387e => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:23:36.674798 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-53af5930-f8f5-481a-820e-9b332597f04d tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:23:36.675402 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-53af5930-f8f5-481a-820e-9b332597f04d tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] [instance: fb16e6d4-57d8-4185-9955-ec1d261b365d] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:23:36.682432 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-53af5930-f8f5-481a-820e-9b332597f04d tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:36.683002 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-53af5930-f8f5-481a-820e-9b332597f04d tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:36.683433 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-53af5930-f8f5-481a-820e-9b332597f04d tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:36.684118 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-53af5930-f8f5-481a-820e-9b332597f04d tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:36.684569 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-53af5930-f8f5-481a-820e-9b332597f04d tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:36.685204 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-53af5930-f8f5-481a-820e-9b332597f04d tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:37.086958 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-53af5930-f8f5-481a-820e-9b332597f04d tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5cfee7994ab404d974d86d77e075209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33bb29688304d0dae3cfdc0eb54b7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:37.097691 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-53af5930-f8f5-481a-820e-9b332597f04d tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] 10.222.0.16 "GET /compute/v2.1/servers/fb16e6d4-57d8-4185-9955-ec1d261b365d" status: 200 len: 1260 microversion: 2.1 time: 0.425383 Oct 31 19:23:37.098587 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 199/391] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:23:36 2022] GET /compute/v2.1/servers/fb16e6d4-57d8-4185-9955-ec1d261b365d => generated 1260 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:23:37.161715 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-bba497cd-62a8-4e63-a42f-6cb396f71f6d tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:23:37.162256 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-bba497cd-62a8-4e63-a42f-6cb396f71f6d tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 24ad6e3e-6043-4eff-afb4-0c6039e825fa] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:23:37.168527 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-bba497cd-62a8-4e63-a42f-6cb396f71f6d tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:37.169017 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-bba497cd-62a8-4e63-a42f-6cb396f71f6d tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:37.169465 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-bba497cd-62a8-4e63-a42f-6cb396f71f6d tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:37.170165 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-bba497cd-62a8-4e63-a42f-6cb396f71f6d tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:37.170619 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-bba497cd-62a8-4e63-a42f-6cb396f71f6d tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:37.171039 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-bba497cd-62a8-4e63-a42f-6cb396f71f6d tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:37.345723 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-bba497cd-62a8-4e63-a42f-6cb396f71f6d tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:37.361256 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-bba497cd-62a8-4e63-a42f-6cb396f71f6d tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:37.363384 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-bba497cd-62a8-4e63-a42f-6cb396f71f6d tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:37.364627 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-bba497cd-62a8-4e63-a42f-6cb396f71f6d tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa" status: 200 len: 1722 microversion: 2.20 time: 0.207126 Oct 31 19:23:37.365248 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 193/392] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 31 19:23:37 2022] GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa => generated 1722 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 19:23:37.506804 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-705b489f-2ded-4684-9f02-4655a5c48d6e tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:23:37.508485 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-705b489f-2ded-4684-9f02-4655a5c48d6e tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] [instance: ecd39339-b802-43f3-aba3-432fd6e5387e] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:23:37.514569 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-705b489f-2ded-4684-9f02-4655a5c48d6e tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:37.515267 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-705b489f-2ded-4684-9f02-4655a5c48d6e tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:37.516567 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-705b489f-2ded-4684-9f02-4655a5c48d6e tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:37.517435 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-705b489f-2ded-4684-9f02-4655a5c48d6e tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:37.518083 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-705b489f-2ded-4684-9f02-4655a5c48d6e tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:37.518694 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-705b489f-2ded-4684-9f02-4655a5c48d6e tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:37.690096 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-705b489f-2ded-4684-9f02-4655a5c48d6e tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b652cca4b94e188b7362606edabb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47ae1789d284a72bb71a6ffe55e7d8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:37.698500 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-705b489f-2ded-4684-9f02-4655a5c48d6e tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] 10.222.0.16 "GET /compute/v2.1/servers/ecd39339-b802-43f3-aba3-432fd6e5387e" status: 200 len: 1358 microversion: 2.1 time: 0.196001 Oct 31 19:23:37.699704 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 200/393] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:23:37 2022] GET /compute/v2.1/servers/ecd39339-b802-43f3-aba3-432fd6e5387e => generated 1358 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:23:37.746058 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [req-ca52ab76-1329-40fc-afa3-2e9cfbc5387e req-bfaae3d8-9617-4858-ade8-263a4f1becff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24ad6e3e-6043-4eff-afb4-0c6039e825fa", "name": "network-vif-unplugged", "status": "completed", "tag": "3807af14-6f9a-4bcc-86d0-c9961d4697ae"}]} {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:23:37.758611 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [req-ca52ab76-1329-40fc-afa3-2e9cfbc5387e req-bfaae3d8-9617-4858-ade8-263a4f1becff service nova] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:37.759275 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [req-ca52ab76-1329-40fc-afa3-2e9cfbc5387e req-bfaae3d8-9617-4858-ade8-263a4f1becff service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:37.759887 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [req-ca52ab76-1329-40fc-afa3-2e9cfbc5387e req-bfaae3d8-9617-4858-ade8-263a4f1becff service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:37.775186 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.compute.server_external_events [req-ca52ab76-1329-40fc-afa3-2e9cfbc5387e req-bfaae3d8-9617-4858-ade8-263a4f1becff service nova] Creating event network-vif-unplugged:3807af14-6f9a-4bcc-86d0-c9961d4697ae for instance 24ad6e3e-6043-4eff-afb4-0c6039e825fa on hv-cinder-86309 Oct 31 19:23:37.780537 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [req-ca52ab76-1329-40fc-afa3-2e9cfbc5387e req-bfaae3d8-9617-4858-ade8-263a4f1becff service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039646 Oct 31 19:23:37.781131 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 194/394] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 31 19:23:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:23:38.120931 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-f8259023-306c-4f36-b404-69d30be066dd tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:23:38.121761 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-f8259023-306c-4f36-b404-69d30be066dd tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] [instance: fb16e6d4-57d8-4185-9955-ec1d261b365d] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:23:38.128634 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-f8259023-306c-4f36-b404-69d30be066dd tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:38.129210 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-f8259023-306c-4f36-b404-69d30be066dd tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:38.129752 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-f8259023-306c-4f36-b404-69d30be066dd tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:38.130536 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-f8259023-306c-4f36-b404-69d30be066dd tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:38.131129 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-f8259023-306c-4f36-b404-69d30be066dd tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:38.131611 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-f8259023-306c-4f36-b404-69d30be066dd tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:38.274032 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-f8259023-306c-4f36-b404-69d30be066dd tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5cfee7994ab404d974d86d77e075209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33bb29688304d0dae3cfdc0eb54b7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:38.282164 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-f8259023-306c-4f36-b404-69d30be066dd tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] 10.222.0.16 "GET /compute/v2.1/servers/fb16e6d4-57d8-4185-9955-ec1d261b365d" status: 200 len: 1260 microversion: 2.1 time: 0.165071 Oct 31 19:23:38.289158 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 201/395] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:23:38 2022] GET /compute/v2.1/servers/fb16e6d4-57d8-4185-9955-ec1d261b365d => generated 1260 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:23:38.391032 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-f70b8097-5671-43cd-bd7f-2c01dc4aa7d5 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:23:38.391869 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-f70b8097-5671-43cd-bd7f-2c01dc4aa7d5 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 24ad6e3e-6043-4eff-afb4-0c6039e825fa] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:23:38.398405 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-f70b8097-5671-43cd-bd7f-2c01dc4aa7d5 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:38.399477 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-f70b8097-5671-43cd-bd7f-2c01dc4aa7d5 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:38.399989 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-f70b8097-5671-43cd-bd7f-2c01dc4aa7d5 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:38.400796 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-f70b8097-5671-43cd-bd7f-2c01dc4aa7d5 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:38.401318 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-f70b8097-5671-43cd-bd7f-2c01dc4aa7d5 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:38.401849 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-f70b8097-5671-43cd-bd7f-2c01dc4aa7d5 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:38.553530 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-f70b8097-5671-43cd-bd7f-2c01dc4aa7d5 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:38.562289 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-f70b8097-5671-43cd-bd7f-2c01dc4aa7d5 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:38.564615 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-f70b8097-5671-43cd-bd7f-2c01dc4aa7d5 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:38.565956 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-f70b8097-5671-43cd-bd7f-2c01dc4aa7d5 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa" status: 200 len: 1722 microversion: 2.20 time: 0.180237 Oct 31 19:23:38.566519 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 195/396] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 31 19:23:38 2022] GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa => generated 1722 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 19:23:38.722781 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-d912388b-4100-4b89-9b82-74e3f25b7778 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:23:38.723439 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-d912388b-4100-4b89-9b82-74e3f25b7778 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] [instance: ecd39339-b802-43f3-aba3-432fd6e5387e] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:23:38.730294 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-d912388b-4100-4b89-9b82-74e3f25b7778 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:38.730766 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-d912388b-4100-4b89-9b82-74e3f25b7778 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:38.731198 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-d912388b-4100-4b89-9b82-74e3f25b7778 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:38.731879 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-d912388b-4100-4b89-9b82-74e3f25b7778 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:38.732326 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-d912388b-4100-4b89-9b82-74e3f25b7778 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:38.732748 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-d912388b-4100-4b89-9b82-74e3f25b7778 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:38.884109 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-d912388b-4100-4b89-9b82-74e3f25b7778 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b652cca4b94e188b7362606edabb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47ae1789d284a72bb71a6ffe55e7d8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:38.892678 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-d912388b-4100-4b89-9b82-74e3f25b7778 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] 10.222.0.16 "GET /compute/v2.1/servers/ecd39339-b802-43f3-aba3-432fd6e5387e" status: 200 len: 1358 microversion: 2.1 time: 0.173759 Oct 31 19:23:38.893387 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 202/397] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:23:38 2022] GET /compute/v2.1/servers/ecd39339-b802-43f3-aba3-432fd6e5387e => generated 1358 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:23:39.305685 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-183efb5a-96a2-483e-aa04-8e8886ca0c59 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:23:39.306705 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-183efb5a-96a2-483e-aa04-8e8886ca0c59 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] [instance: fb16e6d4-57d8-4185-9955-ec1d261b365d] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:23:39.313363 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-183efb5a-96a2-483e-aa04-8e8886ca0c59 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:39.313876 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-183efb5a-96a2-483e-aa04-8e8886ca0c59 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:39.314304 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-183efb5a-96a2-483e-aa04-8e8886ca0c59 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:39.314989 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-183efb5a-96a2-483e-aa04-8e8886ca0c59 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:39.315575 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-183efb5a-96a2-483e-aa04-8e8886ca0c59 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:39.315995 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-183efb5a-96a2-483e-aa04-8e8886ca0c59 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:39.423833 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-332f9484-6478-4b4b-a767-2bd8bdb5718a tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1067053498", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-298495679", "security_groups": [{"name": "tempest-secgroup-smoke-698616685"}], "block_device_mapping_v2": [{"uuid": "012bff3e-71bd-4494-bb2f-4b6098954601", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "adb7c8f5-3156-4d00-ac4d-5e9b81d5fe3b"}]}} {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:23:39.448562 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-183efb5a-96a2-483e-aa04-8e8886ca0c59 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5cfee7994ab404d974d86d77e075209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33bb29688304d0dae3cfdc0eb54b7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:39.457358 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-183efb5a-96a2-483e-aa04-8e8886ca0c59 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] 10.222.0.16 "GET /compute/v2.1/servers/fb16e6d4-57d8-4185-9955-ec1d261b365d" status: 200 len: 1260 microversion: 2.1 time: 0.155698 Oct 31 19:23:39.458021 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 196/398] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:23:39 2022] GET /compute/v2.1/servers/fb16e6d4-57d8-4185-9955-ec1d261b365d => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:23:39.544933 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.network.neutron [None req-332f9484-6478-4b4b-a767-2bd8bdb5718a tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] validate_networks() for [('adb7c8f5-3156-4d00-ac4d-5e9b81d5fe3b', None, None, None, None, None)] {{(pid=118727) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 19:23:39.591132 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-6bc19657-159c-4508-87b1-b4bc581f4ff6 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:23:39.591952 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-6bc19657-159c-4508-87b1-b4bc581f4ff6 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 24ad6e3e-6043-4eff-afb4-0c6039e825fa] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:23:39.597891 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-6bc19657-159c-4508-87b1-b4bc581f4ff6 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:39.598378 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-6bc19657-159c-4508-87b1-b4bc581f4ff6 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:39.598809 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-6bc19657-159c-4508-87b1-b4bc581f4ff6 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:39.599493 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-6bc19657-159c-4508-87b1-b4bc581f4ff6 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:39.599946 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-6bc19657-159c-4508-87b1-b4bc581f4ff6 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:39.600363 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-6bc19657-159c-4508-87b1-b4bc581f4ff6 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:39.761373 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-6bc19657-159c-4508-87b1-b4bc581f4ff6 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:39.769517 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-6bc19657-159c-4508-87b1-b4bc581f4ff6 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:39.771049 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-6bc19657-159c-4508-87b1-b4bc581f4ff6 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:39.772425 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-6bc19657-159c-4508-87b1-b4bc581f4ff6 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa" status: 200 len: 1722 microversion: 2.20 time: 0.185136 Oct 31 19:23:39.773091 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 197/399] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 31 19:23:39 2022] GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa => generated 1722 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 19:23:39.817080 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [req-94ad5b8e-30f9-424c-b2f4-cb692211445f req-95425f79-3979-443e-b011-93d336f77fde service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecd39339-b802-43f3-aba3-432fd6e5387e", "name": "network-vif-plugged", "status": "completed", "tag": "02358090-76d2-46a6-9956-91d3a84a985a"}]} {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:23:39.825150 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG dbcounter [-] [118726] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=118726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:23:39.827598 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [req-94ad5b8e-30f9-424c-b2f4-cb692211445f req-95425f79-3979-443e-b011-93d336f77fde service nova] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:39.828345 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [req-94ad5b8e-30f9-424c-b2f4-cb692211445f req-95425f79-3979-443e-b011-93d336f77fde service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:39.828953 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [req-94ad5b8e-30f9-424c-b2f4-cb692211445f req-95425f79-3979-443e-b011-93d336f77fde service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:39.841796 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.compute.server_external_events [req-94ad5b8e-30f9-424c-b2f4-cb692211445f req-95425f79-3979-443e-b011-93d336f77fde service nova] Creating event network-vif-plugged:02358090-76d2-46a6-9956-91d3a84a985a for instance ecd39339-b802-43f3-aba3-432fd6e5387e on hv-cinder-86309 Oct 31 19:23:39.847134 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [req-94ad5b8e-30f9-424c-b2f4-cb692211445f req-95425f79-3979-443e-b011-93d336f77fde service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034347 Oct 31 19:23:39.847728 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 198/400] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 31 19:23:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:23:39.917014 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-9ab1cbfa-35d8-4edf-80e2-814e2cf47617 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:23:39.917734 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-9ab1cbfa-35d8-4edf-80e2-814e2cf47617 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] [instance: ecd39339-b802-43f3-aba3-432fd6e5387e] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:23:39.924530 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-9ab1cbfa-35d8-4edf-80e2-814e2cf47617 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:39.925007 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-9ab1cbfa-35d8-4edf-80e2-814e2cf47617 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:39.925441 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-9ab1cbfa-35d8-4edf-80e2-814e2cf47617 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:39.926222 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-9ab1cbfa-35d8-4edf-80e2-814e2cf47617 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:39.926673 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-9ab1cbfa-35d8-4edf-80e2-814e2cf47617 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:39.927096 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-9ab1cbfa-35d8-4edf-80e2-814e2cf47617 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:39.942476 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.virt.hardware [None req-332f9484-6478-4b4b-a767-2bd8bdb5718a tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Flavor limits 0:0:0 {{(pid=118727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 19:23:39.942900 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.virt.hardware [None req-332f9484-6478-4b4b-a767-2bd8bdb5718a tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Image limits 0:0:0 {{(pid=118727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 19:23:39.943375 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.virt.hardware [None req-332f9484-6478-4b4b-a767-2bd8bdb5718a tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Flavor pref 0:0:0 {{(pid=118727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 19:23:39.943785 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.virt.hardware [None req-332f9484-6478-4b4b-a767-2bd8bdb5718a tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Image pref 0:0:0 {{(pid=118727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 19:23:39.944195 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.virt.hardware [None req-332f9484-6478-4b4b-a767-2bd8bdb5718a tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 19:23:39.953172 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-332f9484-6478-4b4b-a767-2bd8bdb5718a tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:39.953976 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-332f9484-6478-4b4b-a767-2bd8bdb5718a tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:39.954567 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-332f9484-6478-4b4b-a767-2bd8bdb5718a tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:39.955377 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-332f9484-6478-4b4b-a767-2bd8bdb5718a tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:39.955870 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-332f9484-6478-4b4b-a767-2bd8bdb5718a tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:39.956304 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-332f9484-6478-4b4b-a767-2bd8bdb5718a tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:39.975040 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.quota [None req-332f9484-6478-4b4b-a767-2bd8bdb5718a tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Getting quotas for project 808cc3e5392b4bb7a80b154a60f69ee3. Resources: {'instances', 'ram', 'cores'} {{(pid=118727) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 19:23:39.979628 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.quota [None req-332f9484-6478-4b4b-a767-2bd8bdb5718a tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Getting quotas for user 7e73a60801b04fc7acc4260297fdd2e4 and project 808cc3e5392b4bb7a80b154a60f69ee3. Resources: {'instances', 'ram', 'cores'} {{(pid=118727) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 19:23:40.059993 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-332f9484-6478-4b4b-a767-2bd8bdb5718a tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Going to run 1 instances... {{(pid=118727) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 19:23:40.064944 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-332f9484-6478-4b4b-a767-2bd8bdb5718a tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] [instance: 31bf9c76-adbe-4c58-8d9e-f332e36f86db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='012bff3e-71bd-4494-bb2f-4b6098954601',volume_size=None,volume_type=None)] {{(pid=118727) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 19:23:40.095447 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-9ab1cbfa-35d8-4edf-80e2-814e2cf47617 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b652cca4b94e188b7362606edabb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47ae1789d284a72bb71a6ffe55e7d8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:40.105573 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-9ab1cbfa-35d8-4edf-80e2-814e2cf47617 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] 10.222.0.16 "GET /compute/v2.1/servers/ecd39339-b802-43f3-aba3-432fd6e5387e" status: 200 len: 1358 microversion: 2.1 time: 0.193021 Oct 31 19:23:40.118143 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 199/401] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:23:39 2022] GET /compute/v2.1/servers/ecd39339-b802-43f3-aba3-432fd6e5387e => generated 1358 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 19:23:40.224675 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-332f9484-6478-4b4b-a767-2bd8bdb5718a tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.804833 Oct 31 19:23:40.231906 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 203/402] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 31 19:23:39 2022] POST /compute/v2.1/servers => generated 405 bytes in 813 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 31 19:23:40.237174 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-498e71e1-7e77-4720-af2c-3acd0a77572d tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:23:40.237815 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-498e71e1-7e77-4720-af2c-3acd0a77572d tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] [instance: 31bf9c76-adbe-4c58-8d9e-f332e36f86db] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:23:40.291554 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-498e71e1-7e77-4720-af2c-3acd0a77572d tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e73a60801b04fc7acc4260297fdd2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808cc3e5392b4bb7a80b154a60f69ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:40.299395 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-498e71e1-7e77-4720-af2c-3acd0a77572d tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] 10.222.0.16 "GET /compute/v2.1/servers/31bf9c76-adbe-4c58-8d9e-f332e36f86db" status: 200 len: 1094 microversion: 2.1 time: 0.066713 Oct 31 19:23:40.299959 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 200/403] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:23:40 2022] GET /compute/v2.1/servers/31bf9c76-adbe-4c58-8d9e-f332e36f86db => generated 1094 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 19:23:40.480733 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-4ee58283-cad5-487c-b70d-1beafe1928c7 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:23:40.481411 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-4ee58283-cad5-487c-b70d-1beafe1928c7 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] [instance: fb16e6d4-57d8-4185-9955-ec1d261b365d] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:23:40.489238 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-4ee58283-cad5-487c-b70d-1beafe1928c7 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:40.489784 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-4ee58283-cad5-487c-b70d-1beafe1928c7 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:40.490228 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-4ee58283-cad5-487c-b70d-1beafe1928c7 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:40.490919 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-4ee58283-cad5-487c-b70d-1beafe1928c7 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:40.491376 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-4ee58283-cad5-487c-b70d-1beafe1928c7 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:40.491802 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-4ee58283-cad5-487c-b70d-1beafe1928c7 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:40.675854 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-4ee58283-cad5-487c-b70d-1beafe1928c7 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5cfee7994ab404d974d86d77e075209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33bb29688304d0dae3cfdc0eb54b7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:40.684169 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-4ee58283-cad5-487c-b70d-1beafe1928c7 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] 10.222.0.16 "GET /compute/v2.1/servers/fb16e6d4-57d8-4185-9955-ec1d261b365d" status: 200 len: 1443 microversion: 2.1 time: 0.207966 Oct 31 19:23:40.684955 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 204/404] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:23:40 2022] GET /compute/v2.1/servers/fb16e6d4-57d8-4185-9955-ec1d261b365d => generated 1443 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:23:40.714187 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-7dca0752-dc0d-4904-9953-4daa50f843e0 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:23:40.714755 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-7dca0752-dc0d-4904-9953-4daa50f843e0 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] [instance: fb16e6d4-57d8-4185-9955-ec1d261b365d] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:23:40.738263 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-7dca0752-dc0d-4904-9953-4daa50f843e0 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:40.738967 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-7dca0752-dc0d-4904-9953-4daa50f843e0 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:40.739527 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-7dca0752-dc0d-4904-9953-4daa50f843e0 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:40.740228 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-7dca0752-dc0d-4904-9953-4daa50f843e0 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:40.741775 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-7dca0752-dc0d-4904-9953-4daa50f843e0 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:40.742202 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-7dca0752-dc0d-4904-9953-4daa50f843e0 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:40.800890 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-9f48a24a-51e4-4115-8502-cce81253e996 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:23:40.801495 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-9f48a24a-51e4-4115-8502-cce81253e996 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 24ad6e3e-6043-4eff-afb4-0c6039e825fa] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:23:40.810091 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-9f48a24a-51e4-4115-8502-cce81253e996 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:40.811387 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-9f48a24a-51e4-4115-8502-cce81253e996 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:40.811845 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-9f48a24a-51e4-4115-8502-cce81253e996 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:40.812596 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-9f48a24a-51e4-4115-8502-cce81253e996 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:40.813557 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-9f48a24a-51e4-4115-8502-cce81253e996 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:40.814000 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-9f48a24a-51e4-4115-8502-cce81253e996 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:40.951963 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-7dca0752-dc0d-4904-9953-4daa50f843e0 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5cfee7994ab404d974d86d77e075209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33bb29688304d0dae3cfdc0eb54b7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:40.968316 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-7dca0752-dc0d-4904-9953-4daa50f843e0 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] 10.222.0.16 "GET /compute/v2.1/servers/fb16e6d4-57d8-4185-9955-ec1d261b365d" status: 200 len: 1443 microversion: 2.1 time: 0.257999 Oct 31 19:23:40.969452 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 201/405] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:23:40 2022] GET /compute/v2.1/servers/fb16e6d4-57d8-4185-9955-ec1d261b365d => generated 1443 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:23:40.986316 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-9f48a24a-51e4-4115-8502-cce81253e996 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:40.994489 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-9f48a24a-51e4-4115-8502-cce81253e996 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:40.995946 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-9f48a24a-51e4-4115-8502-cce81253e996 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:40.997076 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-9f48a24a-51e4-4115-8502-cce81253e996 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa" status: 200 len: 1725 microversion: 2.20 time: 0.202482 Oct 31 19:23:40.997653 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 205/406] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 31 19:23:40 2022] GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa => generated 1725 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 19:23:41.023704 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-25e3e30d-8174-4bb5-9bdd-545c9aba4e8e tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "86dbe146-3d33-4a51-81d3-95a8ef697d59"}} {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:23:41.026754 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-25e3e30d-8174-4bb5-9bdd-545c9aba4e8e tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 24ad6e3e-6043-4eff-afb4-0c6039e825fa] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:23:41.034072 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-25e3e30d-8174-4bb5-9bdd-545c9aba4e8e tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:41.034762 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-25e3e30d-8174-4bb5-9bdd-545c9aba4e8e tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:41.035370 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-25e3e30d-8174-4bb5-9bdd-545c9aba4e8e tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:41.036071 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-25e3e30d-8174-4bb5-9bdd-545c9aba4e8e tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:41.036633 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-25e3e30d-8174-4bb5-9bdd-545c9aba4e8e tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:41.037280 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-25e3e30d-8174-4bb5-9bdd-545c9aba4e8e tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:41.129668 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-7a6d4c91-77b6-4724-9fd6-41a91048d00f tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:23:41.130248 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-7a6d4c91-77b6-4724-9fd6-41a91048d00f tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] [instance: ecd39339-b802-43f3-aba3-432fd6e5387e] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:23:41.140488 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-7a6d4c91-77b6-4724-9fd6-41a91048d00f tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:41.141316 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-7a6d4c91-77b6-4724-9fd6-41a91048d00f tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:41.141800 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-7a6d4c91-77b6-4724-9fd6-41a91048d00f tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:41.142560 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-7a6d4c91-77b6-4724-9fd6-41a91048d00f tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:41.143078 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-7a6d4c91-77b6-4724-9fd6-41a91048d00f tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:41.143514 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-7a6d4c91-77b6-4724-9fd6-41a91048d00f tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:41.311329 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-7a6d4c91-77b6-4724-9fd6-41a91048d00f tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b652cca4b94e188b7362606edabb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47ae1789d284a72bb71a6ffe55e7d8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:41.329179 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-7a6d4c91-77b6-4724-9fd6-41a91048d00f tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] 10.222.0.16 "GET /compute/v2.1/servers/ecd39339-b802-43f3-aba3-432fd6e5387e" status: 200 len: 1358 microversion: 2.1 time: 0.203834 Oct 31 19:23:41.330447 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 206/407] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:23:41 2022] GET /compute/v2.1/servers/ecd39339-b802-43f3-aba3-432fd6e5387e => generated 1358 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 19:23:41.335439 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-5335e17f-00be-4ee4-905b-1b9424e751ff tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:23:41.336284 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-5335e17f-00be-4ee4-905b-1b9424e751ff tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] [instance: 31bf9c76-adbe-4c58-8d9e-f332e36f86db] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:23:41.343270 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-5335e17f-00be-4ee4-905b-1b9424e751ff tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:41.344574 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-5335e17f-00be-4ee4-905b-1b9424e751ff tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:41.345229 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-5335e17f-00be-4ee4-905b-1b9424e751ff tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:41.346070 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-5335e17f-00be-4ee4-905b-1b9424e751ff tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:41.346680 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-5335e17f-00be-4ee4-905b-1b9424e751ff tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:41.347722 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-5335e17f-00be-4ee4-905b-1b9424e751ff tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:41.405148 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-25e3e30d-8174-4bb5-9bdd-545c9aba4e8e tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "POST /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.386063 Oct 31 19:23:41.410020 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 202/408] 10.222.0.16 () {62 vars in 1364 bytes} [Mon Oct 31 19:23:41 2022] POST /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa/os-volume_attachments => generated 188 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 19:23:41.438210 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-5335e17f-00be-4ee4-905b-1b9424e751ff tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e73a60801b04fc7acc4260297fdd2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808cc3e5392b4bb7a80b154a60f69ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:41.450994 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-5335e17f-00be-4ee4-905b-1b9424e751ff tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] 10.222.0.16 "GET /compute/v2.1/servers/31bf9c76-adbe-4c58-8d9e-f332e36f86db" status: 200 len: 1136 microversion: 2.1 time: 0.119166 Oct 31 19:23:41.451583 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 207/409] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:23:41 2022] GET /compute/v2.1/servers/31bf9c76-adbe-4c58-8d9e-f332e36f86db => generated 1136 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:23:41.555950 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-c34a6244-f87b-418e-b87c-f59d31d0fed0 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:23:41.556534 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-c34a6244-f87b-418e-b87c-f59d31d0fed0 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 24ad6e3e-6043-4eff-afb4-0c6039e825fa] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:23:41.563634 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-c34a6244-f87b-418e-b87c-f59d31d0fed0 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:41.564054 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-c34a6244-f87b-418e-b87c-f59d31d0fed0 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:41.564494 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-c34a6244-f87b-418e-b87c-f59d31d0fed0 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:41.565176 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-c34a6244-f87b-418e-b87c-f59d31d0fed0 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:41.565653 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-c34a6244-f87b-418e-b87c-f59d31d0fed0 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:41.566104 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-c34a6244-f87b-418e-b87c-f59d31d0fed0 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:41.614723 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-c34a6244-f87b-418e-b87c-f59d31d0fed0 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 24ad6e3e-6043-4eff-afb4-0c6039e825fa] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=118726) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 31 19:23:41.690206 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-c34a6244-f87b-418e-b87c-f59d31d0fed0 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "POST /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa/action" status: 202 len: 0 microversion: 2.20 time: 0.141433 Oct 31 19:23:41.690757 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 203/410] 10.222.0.16 () {62 vars in 1319 bytes} [Mon Oct 31 19:23:41 2022] POST /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa/action => generated 0 bytes in 143 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 31 19:23:41.699727 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-9517509d-76a2-42c4-b545-00c857c1709f tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:23:41.700999 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-9517509d-76a2-42c4-b545-00c857c1709f tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 24ad6e3e-6043-4eff-afb4-0c6039e825fa] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:23:41.710150 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-9517509d-76a2-42c4-b545-00c857c1709f tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:41.710728 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-9517509d-76a2-42c4-b545-00c857c1709f tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:41.711238 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-9517509d-76a2-42c4-b545-00c857c1709f tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:41.712165 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-9517509d-76a2-42c4-b545-00c857c1709f tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:41.712701 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-9517509d-76a2-42c4-b545-00c857c1709f tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:41.713194 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-9517509d-76a2-42c4-b545-00c857c1709f tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:41.869192 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-9517509d-76a2-42c4-b545-00c857c1709f tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:41.880333 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-9517509d-76a2-42c4-b545-00c857c1709f tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:41.883439 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-9517509d-76a2-42c4-b545-00c857c1709f tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:41.885273 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-9517509d-76a2-42c4-b545-00c857c1709f tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa" status: 200 len: 1811 microversion: 2.20 time: 0.190073 Oct 31 19:23:41.885995 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 208/411] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 31 19:23:41 2022] GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa => generated 1811 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 19:23:42.352937 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-7a6a8887-d357-4335-bece-b4b2173af26b tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:23:42.353780 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-7a6a8887-d357-4335-bece-b4b2173af26b tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] [instance: ecd39339-b802-43f3-aba3-432fd6e5387e] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:23:42.361051 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-7a6a8887-d357-4335-bece-b4b2173af26b tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:42.361901 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-7a6a8887-d357-4335-bece-b4b2173af26b tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:42.362407 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-7a6a8887-d357-4335-bece-b4b2173af26b tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:42.363178 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-7a6a8887-d357-4335-bece-b4b2173af26b tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:42.363745 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-7a6a8887-d357-4335-bece-b4b2173af26b tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:42.364167 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-7a6a8887-d357-4335-bece-b4b2173af26b tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:42.480840 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-95ec4a11-f368-445a-a239-0154934bf24b tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:23:42.481570 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-95ec4a11-f368-445a-a239-0154934bf24b tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] [instance: 31bf9c76-adbe-4c58-8d9e-f332e36f86db] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:23:42.497066 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-95ec4a11-f368-445a-a239-0154934bf24b tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:42.497565 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-95ec4a11-f368-445a-a239-0154934bf24b tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:42.498029 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-95ec4a11-f368-445a-a239-0154934bf24b tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:42.498735 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-95ec4a11-f368-445a-a239-0154934bf24b tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:42.499192 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-95ec4a11-f368-445a-a239-0154934bf24b tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:42.499616 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-95ec4a11-f368-445a-a239-0154934bf24b tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:42.573875 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-95ec4a11-f368-445a-a239-0154934bf24b tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e73a60801b04fc7acc4260297fdd2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808cc3e5392b4bb7a80b154a60f69ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:42.582284 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-95ec4a11-f368-445a-a239-0154934bf24b tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] 10.222.0.16 "GET /compute/v2.1/servers/31bf9c76-adbe-4c58-8d9e-f332e36f86db" status: 200 len: 1192 microversion: 2.1 time: 0.110977 Oct 31 19:23:42.582865 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 209/412] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:23:42 2022] GET /compute/v2.1/servers/31bf9c76-adbe-4c58-8d9e-f332e36f86db => generated 1192 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:23:42.604629 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-7a6a8887-d357-4335-bece-b4b2173af26b tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b652cca4b94e188b7362606edabb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47ae1789d284a72bb71a6ffe55e7d8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:42.626583 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-7a6a8887-d357-4335-bece-b4b2173af26b tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] 10.222.0.16 "GET /compute/v2.1/servers/ecd39339-b802-43f3-aba3-432fd6e5387e" status: 200 len: 1358 microversion: 2.1 time: 0.277325 Oct 31 19:23:42.627681 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 204/413] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:23:42 2022] GET /compute/v2.1/servers/ecd39339-b802-43f3-aba3-432fd6e5387e => generated 1358 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:23:42.912988 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-80341f40-68b6-4554-932d-b220a4eaa655 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:23:42.913538 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-80341f40-68b6-4554-932d-b220a4eaa655 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 24ad6e3e-6043-4eff-afb4-0c6039e825fa] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:23:42.920316 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-80341f40-68b6-4554-932d-b220a4eaa655 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:42.920793 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-80341f40-68b6-4554-932d-b220a4eaa655 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:42.921218 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-80341f40-68b6-4554-932d-b220a4eaa655 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:42.921958 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-80341f40-68b6-4554-932d-b220a4eaa655 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:42.923072 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-80341f40-68b6-4554-932d-b220a4eaa655 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:42.923497 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-80341f40-68b6-4554-932d-b220a4eaa655 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:43.058085 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-80341f40-68b6-4554-932d-b220a4eaa655 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:43.067304 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-80341f40-68b6-4554-932d-b220a4eaa655 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:43.068749 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-80341f40-68b6-4554-932d-b220a4eaa655 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:43.069974 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-80341f40-68b6-4554-932d-b220a4eaa655 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa" status: 200 len: 1751 microversion: 2.20 time: 0.161456 Oct 31 19:23:43.070533 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 210/414] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 31 19:23:42 2022] GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa => generated 1751 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 19:23:43.353199 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [req-b9dd3867-887b-473f-b466-dd2aa55de579 req-152f7d67-466c-428b-8270-da487b30afed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb16e6d4-57d8-4185-9955-ec1d261b365d", "tag": "d4d5c6c7-d643-4ff8-859d-8b480d999f74"}]} {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:23:43.375787 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [req-b9dd3867-887b-473f-b466-dd2aa55de579 req-152f7d67-466c-428b-8270-da487b30afed service nova] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:43.376447 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [req-b9dd3867-887b-473f-b466-dd2aa55de579 req-152f7d67-466c-428b-8270-da487b30afed service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:43.377250 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [req-b9dd3867-887b-473f-b466-dd2aa55de579 req-152f7d67-466c-428b-8270-da487b30afed service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:43.398711 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.compute.server_external_events [req-b9dd3867-887b-473f-b466-dd2aa55de579 req-152f7d67-466c-428b-8270-da487b30afed service nova] Creating event network-changed:d4d5c6c7-d643-4ff8-859d-8b480d999f74 for instance fb16e6d4-57d8-4185-9955-ec1d261b365d on hv-cinder-86309 Oct 31 19:23:43.406920 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [req-b9dd3867-887b-473f-b466-dd2aa55de579 req-152f7d67-466c-428b-8270-da487b30afed service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055300 Oct 31 19:23:43.408244 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 205/415] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 31 19:23:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 19:23:43.606068 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-dec7a4aa-3bfa-4b28-8220-8d51635a91a2 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:23:43.606702 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-dec7a4aa-3bfa-4b28-8220-8d51635a91a2 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] [instance: 31bf9c76-adbe-4c58-8d9e-f332e36f86db] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:23:43.612944 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-dec7a4aa-3bfa-4b28-8220-8d51635a91a2 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:43.613419 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-dec7a4aa-3bfa-4b28-8220-8d51635a91a2 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:43.613878 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-dec7a4aa-3bfa-4b28-8220-8d51635a91a2 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:43.614561 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-dec7a4aa-3bfa-4b28-8220-8d51635a91a2 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:43.615010 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-dec7a4aa-3bfa-4b28-8220-8d51635a91a2 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:43.615428 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-dec7a4aa-3bfa-4b28-8220-8d51635a91a2 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:43.651076 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-49e75c4c-ac5c-4248-80dd-e169d0afa1c3 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:23:43.651760 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-49e75c4c-ac5c-4248-80dd-e169d0afa1c3 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] [instance: ecd39339-b802-43f3-aba3-432fd6e5387e] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:23:43.658808 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-49e75c4c-ac5c-4248-80dd-e169d0afa1c3 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:43.659550 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-49e75c4c-ac5c-4248-80dd-e169d0afa1c3 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:43.659984 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-49e75c4c-ac5c-4248-80dd-e169d0afa1c3 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:43.660672 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-49e75c4c-ac5c-4248-80dd-e169d0afa1c3 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:43.661272 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-49e75c4c-ac5c-4248-80dd-e169d0afa1c3 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:43.661712 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-49e75c4c-ac5c-4248-80dd-e169d0afa1c3 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:43.684437 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-dec7a4aa-3bfa-4b28-8220-8d51635a91a2 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e73a60801b04fc7acc4260297fdd2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808cc3e5392b4bb7a80b154a60f69ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:43.693816 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-dec7a4aa-3bfa-4b28-8220-8d51635a91a2 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] 10.222.0.16 "GET /compute/v2.1/servers/31bf9c76-adbe-4c58-8d9e-f332e36f86db" status: 200 len: 1192 microversion: 2.1 time: 0.091813 Oct 31 19:23:43.694566 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 211/416] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:23:43 2022] GET /compute/v2.1/servers/31bf9c76-adbe-4c58-8d9e-f332e36f86db => generated 1192 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:23:43.804460 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-49e75c4c-ac5c-4248-80dd-e169d0afa1c3 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b652cca4b94e188b7362606edabb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47ae1789d284a72bb71a6ffe55e7d8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:43.811972 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-49e75c4c-ac5c-4248-80dd-e169d0afa1c3 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] 10.222.0.16 "GET /compute/v2.1/servers/ecd39339-b802-43f3-aba3-432fd6e5387e" status: 200 len: 1549 microversion: 2.1 time: 0.165237 Oct 31 19:23:43.813156 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 206/417] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:23:43 2022] GET /compute/v2.1/servers/ecd39339-b802-43f3-aba3-432fd6e5387e => generated 1549 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 19:23:43.836112 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-b1435901-a07d-437e-821a-59fcb87aa59b tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:23:43.836969 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-b1435901-a07d-437e-821a-59fcb87aa59b tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] [instance: ecd39339-b802-43f3-aba3-432fd6e5387e] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:23:43.845897 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-b1435901-a07d-437e-821a-59fcb87aa59b tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:43.846683 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-b1435901-a07d-437e-821a-59fcb87aa59b tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:43.847186 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-b1435901-a07d-437e-821a-59fcb87aa59b tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:43.848255 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-b1435901-a07d-437e-821a-59fcb87aa59b tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:43.848727 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-b1435901-a07d-437e-821a-59fcb87aa59b tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:43.849164 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-b1435901-a07d-437e-821a-59fcb87aa59b tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:44.016434 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-b1435901-a07d-437e-821a-59fcb87aa59b tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b652cca4b94e188b7362606edabb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47ae1789d284a72bb71a6ffe55e7d8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:44.024164 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-b1435901-a07d-437e-821a-59fcb87aa59b tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] 10.222.0.16 "GET /compute/v2.1/servers/ecd39339-b802-43f3-aba3-432fd6e5387e" status: 200 len: 1549 microversion: 2.1 time: 0.192015 Oct 31 19:23:44.024957 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 212/418] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:23:43 2022] GET /compute/v2.1/servers/ecd39339-b802-43f3-aba3-432fd6e5387e => generated 1549 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:23:44.046072 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-1ed4e433-432d-4562-8d6d-a14e2ab58b9d tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:23:44.051480 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-1ed4e433-432d-4562-8d6d-a14e2ab58b9d tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '34b652cca4b94e188b7362606edabb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47ae1789d284a72bb71a6ffe55e7d8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:44.052156 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-1ed4e433-432d-4562-8d6d-a14e2ab58b9d tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Searching by: {'deleted': False, 'project_id': 'c47ae1789d284a72bb71a6ffe55e7d8b'} {{(pid=118726) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 31 19:23:44.058858 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-1ed4e433-432d-4562-8d6d-a14e2ab58b9d tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:44.059339 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-1ed4e433-432d-4562-8d6d-a14e2ab58b9d tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:44.059771 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-1ed4e433-432d-4562-8d6d-a14e2ab58b9d tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:44.060486 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-1ed4e433-432d-4562-8d6d-a14e2ab58b9d tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:44.060936 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-1ed4e433-432d-4562-8d6d-a14e2ab58b9d tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:44.061357 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-1ed4e433-432d-4562-8d6d-a14e2ab58b9d tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:44.106397 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-7e2e19cb-7fa6-4605-81d0-081e0a67ef19 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:23:44.107440 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-7e2e19cb-7fa6-4605-81d0-081e0a67ef19 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 24ad6e3e-6043-4eff-afb4-0c6039e825fa] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:23:44.114489 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-7e2e19cb-7fa6-4605-81d0-081e0a67ef19 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:44.115123 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-7e2e19cb-7fa6-4605-81d0-081e0a67ef19 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:44.115911 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-7e2e19cb-7fa6-4605-81d0-081e0a67ef19 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:44.116530 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-7e2e19cb-7fa6-4605-81d0-081e0a67ef19 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:44.116978 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-7e2e19cb-7fa6-4605-81d0-081e0a67ef19 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:44.117547 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-7e2e19cb-7fa6-4605-81d0-081e0a67ef19 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:44.156996 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.multi_cell_list [None req-1ed4e433-432d-4562-8d6d-a14e2ab58b9d tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=118726) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 31 19:23:44.321031 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG dbcounter [-] [118726] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=118726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:23:44.323913 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-1ed4e433-432d-4562-8d6d-a14e2ab58b9d tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.281327 Oct 31 19:23:44.325338 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 207/419] 10.222.0.16 () {58 vars in 1125 bytes} [Mon Oct 31 19:23:44 2022] GET /compute/v2.1/servers => generated 343 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:23:44.338909 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-eec4842c-1272-42e4-9d0c-d05882023a85 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:23:44.340051 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-eec4842c-1272-42e4-9d0c-d05882023a85 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] [instance: ecd39339-b802-43f3-aba3-432fd6e5387e] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:23:44.341857 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-7e2e19cb-7fa6-4605-81d0-081e0a67ef19 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:44.351947 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-eec4842c-1272-42e4-9d0c-d05882023a85 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:44.352912 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-eec4842c-1272-42e4-9d0c-d05882023a85 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:44.353595 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-eec4842c-1272-42e4-9d0c-d05882023a85 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:44.355382 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-7e2e19cb-7fa6-4605-81d0-081e0a67ef19 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:44.355859 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-eec4842c-1272-42e4-9d0c-d05882023a85 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:44.356452 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-eec4842c-1272-42e4-9d0c-d05882023a85 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:44.361654 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-eec4842c-1272-42e4-9d0c-d05882023a85 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:44.365257 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-7e2e19cb-7fa6-4605-81d0-081e0a67ef19 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:44.368123 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-7e2e19cb-7fa6-4605-81d0-081e0a67ef19 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa" status: 200 len: 1753 microversion: 2.20 time: 0.266251 Oct 31 19:23:44.383163 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 213/420] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 31 19:23:44 2022] GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa => generated 1753 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 19:23:44.637130 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-eec4842c-1272-42e4-9d0c-d05882023a85 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b652cca4b94e188b7362606edabb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47ae1789d284a72bb71a6ffe55e7d8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:44.646208 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-eec4842c-1272-42e4-9d0c-d05882023a85 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] 10.222.0.16 "GET /compute/v2.1/servers/ecd39339-b802-43f3-aba3-432fd6e5387e" status: 200 len: 1549 microversion: 2.1 time: 0.311722 Oct 31 19:23:44.647456 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 208/421] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:23:44 2022] GET /compute/v2.1/servers/ecd39339-b802-43f3-aba3-432fd6e5387e => generated 1549 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 19:23:44.717551 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-72674a46-d240-4e4d-a10f-6749bd65dd9d tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:23:44.718375 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-72674a46-d240-4e4d-a10f-6749bd65dd9d tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] [instance: 31bf9c76-adbe-4c58-8d9e-f332e36f86db] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:23:44.732232 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-72674a46-d240-4e4d-a10f-6749bd65dd9d tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:44.734920 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-72674a46-d240-4e4d-a10f-6749bd65dd9d tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:44.735765 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-72674a46-d240-4e4d-a10f-6749bd65dd9d tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:44.736853 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-72674a46-d240-4e4d-a10f-6749bd65dd9d tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:44.737738 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-72674a46-d240-4e4d-a10f-6749bd65dd9d tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:44.738587 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-72674a46-d240-4e4d-a10f-6749bd65dd9d tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:44.934817 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-72674a46-d240-4e4d-a10f-6749bd65dd9d tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e73a60801b04fc7acc4260297fdd2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808cc3e5392b4bb7a80b154a60f69ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:44.937038 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG dbcounter [-] [118727] Writing DB stats nova_cell1:SELECT=100 {{(pid=118727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:23:44.944092 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-72674a46-d240-4e4d-a10f-6749bd65dd9d tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] 10.222.0.16 "GET /compute/v2.1/servers/31bf9c76-adbe-4c58-8d9e-f332e36f86db" status: 200 len: 1210 microversion: 2.1 time: 0.231563 Oct 31 19:23:44.960984 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 214/422] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:23:44 2022] GET /compute/v2.1/servers/31bf9c76-adbe-4c58-8d9e-f332e36f86db => generated 1210 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:23:45.400248 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-5c470e4e-3c12-4ef2-a3d2-f0a6211755c5 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:23:45.400850 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-5c470e4e-3c12-4ef2-a3d2-f0a6211755c5 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 24ad6e3e-6043-4eff-afb4-0c6039e825fa] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:23:45.407894 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-5c470e4e-3c12-4ef2-a3d2-f0a6211755c5 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:45.408372 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-5c470e4e-3c12-4ef2-a3d2-f0a6211755c5 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:45.408802 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-5c470e4e-3c12-4ef2-a3d2-f0a6211755c5 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:45.409498 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-5c470e4e-3c12-4ef2-a3d2-f0a6211755c5 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:45.409989 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-5c470e4e-3c12-4ef2-a3d2-f0a6211755c5 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:45.410408 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-5c470e4e-3c12-4ef2-a3d2-f0a6211755c5 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:45.551109 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-5c470e4e-3c12-4ef2-a3d2-f0a6211755c5 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:45.559995 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-5c470e4e-3c12-4ef2-a3d2-f0a6211755c5 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:45.561452 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-5c470e4e-3c12-4ef2-a3d2-f0a6211755c5 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:45.563197 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-5c470e4e-3c12-4ef2-a3d2-f0a6211755c5 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa" status: 200 len: 1753 microversion: 2.20 time: 0.166826 Oct 31 19:23:45.563765 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 209/423] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 31 19:23:45 2022] GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa => generated 1753 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 19:23:45.968044 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-87e04903-123b-4fc7-a3bd-e0c5fe02a0a7 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:23:45.968658 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-87e04903-123b-4fc7-a3bd-e0c5fe02a0a7 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] [instance: 31bf9c76-adbe-4c58-8d9e-f332e36f86db] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:23:45.976401 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-87e04903-123b-4fc7-a3bd-e0c5fe02a0a7 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:45.976886 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-87e04903-123b-4fc7-a3bd-e0c5fe02a0a7 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:45.977351 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-87e04903-123b-4fc7-a3bd-e0c5fe02a0a7 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:45.978071 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-87e04903-123b-4fc7-a3bd-e0c5fe02a0a7 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:45.978555 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-87e04903-123b-4fc7-a3bd-e0c5fe02a0a7 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:45.978998 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-87e04903-123b-4fc7-a3bd-e0c5fe02a0a7 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:46.201969 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-87e04903-123b-4fc7-a3bd-e0c5fe02a0a7 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e73a60801b04fc7acc4260297fdd2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808cc3e5392b4bb7a80b154a60f69ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:46.209580 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-87e04903-123b-4fc7-a3bd-e0c5fe02a0a7 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] 10.222.0.16 "GET /compute/v2.1/servers/31bf9c76-adbe-4c58-8d9e-f332e36f86db" status: 200 len: 1265 microversion: 2.1 time: 0.245315 Oct 31 19:23:46.210357 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 215/424] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:23:45 2022] GET /compute/v2.1/servers/31bf9c76-adbe-4c58-8d9e-f332e36f86db => generated 1265 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:23:46.336813 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [req-a4c43777-e5ff-4f2d-8e50-9147e84d9ee5 req-e0a9921f-0aaf-4f0e-922f-e354a4b28406 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31bf9c76-adbe-4c58-8d9e-f332e36f86db", "tag": "1bff50b4-bfa9-4d6c-bcae-38aef9bf842c"}]} {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:23:46.346972 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [req-a4c43777-e5ff-4f2d-8e50-9147e84d9ee5 req-e0a9921f-0aaf-4f0e-922f-e354a4b28406 service nova] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:46.347448 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [req-a4c43777-e5ff-4f2d-8e50-9147e84d9ee5 req-e0a9921f-0aaf-4f0e-922f-e354a4b28406 service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:46.347883 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [req-a4c43777-e5ff-4f2d-8e50-9147e84d9ee5 req-e0a9921f-0aaf-4f0e-922f-e354a4b28406 service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:46.361831 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.compute.server_external_events [req-a4c43777-e5ff-4f2d-8e50-9147e84d9ee5 req-e0a9921f-0aaf-4f0e-922f-e354a4b28406 service nova] Creating event network-changed:1bff50b4-bfa9-4d6c-bcae-38aef9bf842c for instance 31bf9c76-adbe-4c58-8d9e-f332e36f86db on hv-cinder-86309 Oct 31 19:23:46.364453 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [req-a4c43777-e5ff-4f2d-8e50-9147e84d9ee5 req-e0a9921f-0aaf-4f0e-922f-e354a4b28406 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031624 Oct 31 19:23:46.365508 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 210/425] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 31 19:23:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:23:46.373325 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-117f0b98-ea8c-4b52-b92e-695ce1fe3557 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7a9a6113-0daf-42e1-85ca-351667a63f62"}} {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:23:46.375760 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-117f0b98-ea8c-4b52-b92e-695ce1fe3557 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] [instance: ecd39339-b802-43f3-aba3-432fd6e5387e] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:23:46.381885 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-117f0b98-ea8c-4b52-b92e-695ce1fe3557 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:46.382369 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-117f0b98-ea8c-4b52-b92e-695ce1fe3557 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:46.382902 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-117f0b98-ea8c-4b52-b92e-695ce1fe3557 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:46.383492 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-117f0b98-ea8c-4b52-b92e-695ce1fe3557 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:46.383924 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-117f0b98-ea8c-4b52-b92e-695ce1fe3557 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:46.384342 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-117f0b98-ea8c-4b52-b92e-695ce1fe3557 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:46.590605 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-97b45656-a055-4678-bf40-d7bb0b2ab085 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:23:46.591524 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-97b45656-a055-4678-bf40-d7bb0b2ab085 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 24ad6e3e-6043-4eff-afb4-0c6039e825fa] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:23:46.605304 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-97b45656-a055-4678-bf40-d7bb0b2ab085 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:46.606229 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-97b45656-a055-4678-bf40-d7bb0b2ab085 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:46.606815 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-97b45656-a055-4678-bf40-d7bb0b2ab085 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:46.608073 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-97b45656-a055-4678-bf40-d7bb0b2ab085 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:46.608673 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-97b45656-a055-4678-bf40-d7bb0b2ab085 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:46.609886 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-97b45656-a055-4678-bf40-d7bb0b2ab085 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:46.740892 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-117f0b98-ea8c-4b52-b92e-695ce1fe3557 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] 10.222.0.16 "POST /compute/v2.1/servers/ecd39339-b802-43f3-aba3-432fd6e5387e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.371216 Oct 31 19:23:46.742200 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 216/426] 10.222.0.16 () {60 vars in 1323 bytes} [Mon Oct 31 19:23:46 2022] POST /compute/v2.1/servers/ecd39339-b802-43f3-aba3-432fd6e5387e/os-volume_attachments => generated 194 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:23:46.952313 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-97b45656-a055-4678-bf40-d7bb0b2ab085 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:46.968278 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-97b45656-a055-4678-bf40-d7bb0b2ab085 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:46.970038 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-97b45656-a055-4678-bf40-d7bb0b2ab085 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:46.971318 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-97b45656-a055-4678-bf40-d7bb0b2ab085 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa" status: 200 len: 1809 microversion: 2.20 time: 0.386031 Oct 31 19:23:46.971956 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 211/427] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 31 19:23:46 2022] GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa => generated 1809 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 19:23:47.234715 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-ce301920-0b87-40d9-a6b0-e2e5fd7de73e tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:23:47.236064 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-ce301920-0b87-40d9-a6b0-e2e5fd7de73e tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] [instance: 31bf9c76-adbe-4c58-8d9e-f332e36f86db] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:23:47.242759 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-ce301920-0b87-40d9-a6b0-e2e5fd7de73e tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:47.243250 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-ce301920-0b87-40d9-a6b0-e2e5fd7de73e tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:47.243866 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-ce301920-0b87-40d9-a6b0-e2e5fd7de73e tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:47.244801 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-ce301920-0b87-40d9-a6b0-e2e5fd7de73e tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:47.245441 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-ce301920-0b87-40d9-a6b0-e2e5fd7de73e tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:47.246061 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-ce301920-0b87-40d9-a6b0-e2e5fd7de73e tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:47.750322 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-ce301920-0b87-40d9-a6b0-e2e5fd7de73e tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e73a60801b04fc7acc4260297fdd2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808cc3e5392b4bb7a80b154a60f69ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:47.758836 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-ce301920-0b87-40d9-a6b0-e2e5fd7de73e tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] 10.222.0.16 "GET /compute/v2.1/servers/31bf9c76-adbe-4c58-8d9e-f332e36f86db" status: 200 len: 1265 microversion: 2.1 time: 0.530250 Oct 31 19:23:47.759404 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 217/428] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:23:47 2022] GET /compute/v2.1/servers/31bf9c76-adbe-4c58-8d9e-f332e36f86db => generated 1265 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:23:47.996318 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-f5c4d6f7-0515-44d8-adc6-c04619e27861 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:23:47.996924 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-f5c4d6f7-0515-44d8-adc6-c04619e27861 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 24ad6e3e-6043-4eff-afb4-0c6039e825fa] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:23:48.004471 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-f5c4d6f7-0515-44d8-adc6-c04619e27861 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:48.004954 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-f5c4d6f7-0515-44d8-adc6-c04619e27861 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:48.005377 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-f5c4d6f7-0515-44d8-adc6-c04619e27861 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:48.006096 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-f5c4d6f7-0515-44d8-adc6-c04619e27861 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:48.006541 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-f5c4d6f7-0515-44d8-adc6-c04619e27861 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:48.006955 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-f5c4d6f7-0515-44d8-adc6-c04619e27861 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:48.142677 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-f5c4d6f7-0515-44d8-adc6-c04619e27861 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:48.151506 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-f5c4d6f7-0515-44d8-adc6-c04619e27861 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:48.152935 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-f5c4d6f7-0515-44d8-adc6-c04619e27861 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:48.154102 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-f5c4d6f7-0515-44d8-adc6-c04619e27861 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa" status: 200 len: 1809 microversion: 2.20 time: 0.161856 Oct 31 19:23:48.154656 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 212/429] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 31 19:23:47 2022] GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 19:23:48.784575 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-2a7898e2-7a6e-4aed-8e7d-66f6356e84da tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:23:48.785250 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-2a7898e2-7a6e-4aed-8e7d-66f6356e84da tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] [instance: 31bf9c76-adbe-4c58-8d9e-f332e36f86db] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:23:48.793954 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-2a7898e2-7a6e-4aed-8e7d-66f6356e84da tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:48.794723 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-2a7898e2-7a6e-4aed-8e7d-66f6356e84da tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:48.795308 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-2a7898e2-7a6e-4aed-8e7d-66f6356e84da tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:48.796330 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-2a7898e2-7a6e-4aed-8e7d-66f6356e84da tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:48.797677 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-2a7898e2-7a6e-4aed-8e7d-66f6356e84da tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:48.798373 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-2a7898e2-7a6e-4aed-8e7d-66f6356e84da tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:48.986560 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-2a7898e2-7a6e-4aed-8e7d-66f6356e84da tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e73a60801b04fc7acc4260297fdd2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808cc3e5392b4bb7a80b154a60f69ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:48.996899 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-2a7898e2-7a6e-4aed-8e7d-66f6356e84da tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] 10.222.0.16 "GET /compute/v2.1/servers/31bf9c76-adbe-4c58-8d9e-f332e36f86db" status: 200 len: 1265 microversion: 2.1 time: 0.216705 Oct 31 19:23:48.997640 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 218/430] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:23:48 2022] GET /compute/v2.1/servers/31bf9c76-adbe-4c58-8d9e-f332e36f86db => generated 1265 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:23:49.180568 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-4fd70400-340b-448b-9eab-db7798fe81b6 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:23:49.181139 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-4fd70400-340b-448b-9eab-db7798fe81b6 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 24ad6e3e-6043-4eff-afb4-0c6039e825fa] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:23:49.187445 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-4fd70400-340b-448b-9eab-db7798fe81b6 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:49.187927 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-4fd70400-340b-448b-9eab-db7798fe81b6 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:49.188356 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-4fd70400-340b-448b-9eab-db7798fe81b6 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:49.189038 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-4fd70400-340b-448b-9eab-db7798fe81b6 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:49.189495 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-4fd70400-340b-448b-9eab-db7798fe81b6 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:49.189948 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-4fd70400-340b-448b-9eab-db7798fe81b6 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:49.321095 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-4fd70400-340b-448b-9eab-db7798fe81b6 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:49.330313 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-4fd70400-340b-448b-9eab-db7798fe81b6 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:49.332207 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-4fd70400-340b-448b-9eab-db7798fe81b6 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:49.333516 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-4fd70400-340b-448b-9eab-db7798fe81b6 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa" status: 200 len: 1809 microversion: 2.20 time: 0.156909 Oct 31 19:23:49.334194 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 213/431] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 31 19:23:49 2022] GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 19:23:50.020780 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-11382553-5e82-4a11-96f5-8cd8472b06b9 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:23:50.022050 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-11382553-5e82-4a11-96f5-8cd8472b06b9 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] [instance: 31bf9c76-adbe-4c58-8d9e-f332e36f86db] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:23:50.024475 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG dbcounter [-] [118727] Writing DB stats nova_cell0:SELECT=2 {{(pid=118727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:23:50.025516 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG dbcounter [-] [118727] Writing DB stats nova_cell0:SELECT=6 {{(pid=118727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:23:50.034073 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-11382553-5e82-4a11-96f5-8cd8472b06b9 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:50.034556 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-11382553-5e82-4a11-96f5-8cd8472b06b9 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:50.035286 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-11382553-5e82-4a11-96f5-8cd8472b06b9 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:50.036219 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-11382553-5e82-4a11-96f5-8cd8472b06b9 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:50.036821 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-11382553-5e82-4a11-96f5-8cd8472b06b9 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:50.037393 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-11382553-5e82-4a11-96f5-8cd8472b06b9 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:50.191114 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-11382553-5e82-4a11-96f5-8cd8472b06b9 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e73a60801b04fc7acc4260297fdd2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808cc3e5392b4bb7a80b154a60f69ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:50.206951 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-11382553-5e82-4a11-96f5-8cd8472b06b9 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] 10.222.0.16 "GET /compute/v2.1/servers/31bf9c76-adbe-4c58-8d9e-f332e36f86db" status: 200 len: 1265 microversion: 2.1 time: 0.189547 Oct 31 19:23:50.212951 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 219/432] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:23:50 2022] GET /compute/v2.1/servers/31bf9c76-adbe-4c58-8d9e-f332e36f86db => generated 1265 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:23:50.361455 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-2962f0ad-4203-4659-bc24-fedfe89b136a tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:23:50.363376 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-2962f0ad-4203-4659-bc24-fedfe89b136a tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 24ad6e3e-6043-4eff-afb4-0c6039e825fa] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:23:50.370549 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG dbcounter [-] [118726] Writing DB stats nova_cell0:SELECT=2 {{(pid=118726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:23:50.373156 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-2962f0ad-4203-4659-bc24-fedfe89b136a tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:50.373883 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-2962f0ad-4203-4659-bc24-fedfe89b136a tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:50.374465 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-2962f0ad-4203-4659-bc24-fedfe89b136a tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:50.376312 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-2962f0ad-4203-4659-bc24-fedfe89b136a tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:50.376911 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-2962f0ad-4203-4659-bc24-fedfe89b136a tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:50.377473 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-2962f0ad-4203-4659-bc24-fedfe89b136a tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:50.522443 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-2962f0ad-4203-4659-bc24-fedfe89b136a tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:50.531435 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-2962f0ad-4203-4659-bc24-fedfe89b136a tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:50.532888 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-2962f0ad-4203-4659-bc24-fedfe89b136a tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:50.534290 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-2962f0ad-4203-4659-bc24-fedfe89b136a tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa" status: 200 len: 1809 microversion: 2.20 time: 0.177812 Oct 31 19:23:50.535015 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 214/433] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 31 19:23:50 2022] GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa => generated 1809 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 19:23:51.236561 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-7ab40c55-97e7-4d89-bbfe-7515ce976e13 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:23:51.237179 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-7ab40c55-97e7-4d89-bbfe-7515ce976e13 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] [instance: 31bf9c76-adbe-4c58-8d9e-f332e36f86db] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:23:51.243732 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-7ab40c55-97e7-4d89-bbfe-7515ce976e13 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:51.244281 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-7ab40c55-97e7-4d89-bbfe-7515ce976e13 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:51.244723 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-7ab40c55-97e7-4d89-bbfe-7515ce976e13 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:51.245427 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-7ab40c55-97e7-4d89-bbfe-7515ce976e13 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:51.245911 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-7ab40c55-97e7-4d89-bbfe-7515ce976e13 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:51.246340 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-7ab40c55-97e7-4d89-bbfe-7515ce976e13 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:51.391711 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-7ab40c55-97e7-4d89-bbfe-7515ce976e13 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e73a60801b04fc7acc4260297fdd2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808cc3e5392b4bb7a80b154a60f69ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:51.424048 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-7ab40c55-97e7-4d89-bbfe-7515ce976e13 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] 10.222.0.16 "GET /compute/v2.1/servers/31bf9c76-adbe-4c58-8d9e-f332e36f86db" status: 200 len: 1265 microversion: 2.1 time: 0.191274 Oct 31 19:23:51.424649 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 220/434] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:23:51 2022] GET /compute/v2.1/servers/31bf9c76-adbe-4c58-8d9e-f332e36f86db => generated 1265 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:23:51.561019 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-99bbb914-90cf-4614-b5b1-cb79b494c6c2 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:23:51.561928 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-99bbb914-90cf-4614-b5b1-cb79b494c6c2 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 24ad6e3e-6043-4eff-afb4-0c6039e825fa] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:23:51.569929 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-99bbb914-90cf-4614-b5b1-cb79b494c6c2 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:51.570671 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-99bbb914-90cf-4614-b5b1-cb79b494c6c2 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:51.571106 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-99bbb914-90cf-4614-b5b1-cb79b494c6c2 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:51.571876 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-99bbb914-90cf-4614-b5b1-cb79b494c6c2 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:51.572331 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-99bbb914-90cf-4614-b5b1-cb79b494c6c2 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:51.572762 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-99bbb914-90cf-4614-b5b1-cb79b494c6c2 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:51.713924 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-99bbb914-90cf-4614-b5b1-cb79b494c6c2 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:51.722810 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-99bbb914-90cf-4614-b5b1-cb79b494c6c2 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:51.724253 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-99bbb914-90cf-4614-b5b1-cb79b494c6c2 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:51.725398 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-99bbb914-90cf-4614-b5b1-cb79b494c6c2 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa" status: 200 len: 1809 microversion: 2.20 time: 0.169070 Oct 31 19:23:51.726206 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 215/435] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 31 19:23:51 2022] GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa => generated 1809 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 19:23:52.448245 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-6739f03d-9204-43e6-a587-5287b7e5b372 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:23:52.448804 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-6739f03d-9204-43e6-a587-5287b7e5b372 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] [instance: 31bf9c76-adbe-4c58-8d9e-f332e36f86db] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:23:52.456144 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-6739f03d-9204-43e6-a587-5287b7e5b372 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:52.456633 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-6739f03d-9204-43e6-a587-5287b7e5b372 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:52.457068 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-6739f03d-9204-43e6-a587-5287b7e5b372 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:52.457804 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-6739f03d-9204-43e6-a587-5287b7e5b372 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:52.458263 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-6739f03d-9204-43e6-a587-5287b7e5b372 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:52.458692 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-6739f03d-9204-43e6-a587-5287b7e5b372 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:52.593002 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-6739f03d-9204-43e6-a587-5287b7e5b372 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e73a60801b04fc7acc4260297fdd2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808cc3e5392b4bb7a80b154a60f69ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:52.603792 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-6739f03d-9204-43e6-a587-5287b7e5b372 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] 10.222.0.16 "GET /compute/v2.1/servers/31bf9c76-adbe-4c58-8d9e-f332e36f86db" status: 200 len: 1265 microversion: 2.1 time: 0.159521 Oct 31 19:23:52.604512 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 221/436] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:23:52 2022] GET /compute/v2.1/servers/31bf9c76-adbe-4c58-8d9e-f332e36f86db => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:23:52.757454 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-46261442-e34b-4ff5-a0d2-aa6d7dba5929 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:23:52.758934 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-46261442-e34b-4ff5-a0d2-aa6d7dba5929 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 24ad6e3e-6043-4eff-afb4-0c6039e825fa] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:23:52.765998 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-46261442-e34b-4ff5-a0d2-aa6d7dba5929 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:52.766485 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-46261442-e34b-4ff5-a0d2-aa6d7dba5929 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:52.766924 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-46261442-e34b-4ff5-a0d2-aa6d7dba5929 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:52.767629 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-46261442-e34b-4ff5-a0d2-aa6d7dba5929 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:52.768087 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-46261442-e34b-4ff5-a0d2-aa6d7dba5929 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:52.768509 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-46261442-e34b-4ff5-a0d2-aa6d7dba5929 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:52.901304 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-46261442-e34b-4ff5-a0d2-aa6d7dba5929 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:52.910804 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-46261442-e34b-4ff5-a0d2-aa6d7dba5929 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:52.912675 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-46261442-e34b-4ff5-a0d2-aa6d7dba5929 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:52.914124 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-46261442-e34b-4ff5-a0d2-aa6d7dba5929 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa" status: 200 len: 1809 microversion: 2.20 time: 0.162010 Oct 31 19:23:52.914666 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 216/437] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 31 19:23:52 2022] GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa => generated 1809 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 19:23:53.628466 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-dbf08d2e-f611-4904-b469-008ed5f6096d tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:23:53.629031 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-dbf08d2e-f611-4904-b469-008ed5f6096d tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] [instance: 31bf9c76-adbe-4c58-8d9e-f332e36f86db] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:23:53.635401 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-dbf08d2e-f611-4904-b469-008ed5f6096d tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:53.635875 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-dbf08d2e-f611-4904-b469-008ed5f6096d tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:53.636304 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-dbf08d2e-f611-4904-b469-008ed5f6096d tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:53.636989 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-dbf08d2e-f611-4904-b469-008ed5f6096d tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:53.637437 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-dbf08d2e-f611-4904-b469-008ed5f6096d tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:53.637878 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-dbf08d2e-f611-4904-b469-008ed5f6096d tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:53.788959 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-dbf08d2e-f611-4904-b469-008ed5f6096d tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e73a60801b04fc7acc4260297fdd2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808cc3e5392b4bb7a80b154a60f69ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:53.805067 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-dbf08d2e-f611-4904-b469-008ed5f6096d tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] 10.222.0.16 "GET /compute/v2.1/servers/31bf9c76-adbe-4c58-8d9e-f332e36f86db" status: 200 len: 1265 microversion: 2.1 time: 0.181211 Oct 31 19:23:53.806088 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 222/438] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:23:53 2022] GET /compute/v2.1/servers/31bf9c76-adbe-4c58-8d9e-f332e36f86db => generated 1265 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:23:53.942110 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-58e45e87-1f20-4b91-a7ac-c83527249a47 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:23:53.943434 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-58e45e87-1f20-4b91-a7ac-c83527249a47 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 24ad6e3e-6043-4eff-afb4-0c6039e825fa] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:23:53.950364 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-58e45e87-1f20-4b91-a7ac-c83527249a47 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:53.950941 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-58e45e87-1f20-4b91-a7ac-c83527249a47 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:53.951442 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-58e45e87-1f20-4b91-a7ac-c83527249a47 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:53.952366 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-58e45e87-1f20-4b91-a7ac-c83527249a47 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:53.953520 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-58e45e87-1f20-4b91-a7ac-c83527249a47 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:53.953965 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-58e45e87-1f20-4b91-a7ac-c83527249a47 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:54.090941 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-58e45e87-1f20-4b91-a7ac-c83527249a47 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:54.093103 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG dbcounter [-] [118726] Writing DB stats nova_cell0:SELECT=2 {{(pid=118726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:23:54.101322 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-58e45e87-1f20-4b91-a7ac-c83527249a47 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:54.102784 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-58e45e87-1f20-4b91-a7ac-c83527249a47 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:54.103996 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-58e45e87-1f20-4b91-a7ac-c83527249a47 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa" status: 200 len: 1809 microversion: 2.20 time: 0.165879 Oct 31 19:23:54.104733 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 217/439] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 31 19:23:53 2022] GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa => generated 1809 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 19:23:54.828465 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-28e8cf89-721e-4672-935c-84cb4e9fc682 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:23:54.829191 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-28e8cf89-721e-4672-935c-84cb4e9fc682 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] [instance: 31bf9c76-adbe-4c58-8d9e-f332e36f86db] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:23:54.835904 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-28e8cf89-721e-4672-935c-84cb4e9fc682 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:54.836391 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-28e8cf89-721e-4672-935c-84cb4e9fc682 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:54.836830 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-28e8cf89-721e-4672-935c-84cb4e9fc682 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:54.837528 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-28e8cf89-721e-4672-935c-84cb4e9fc682 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:54.838175 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-28e8cf89-721e-4672-935c-84cb4e9fc682 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:54.838757 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-28e8cf89-721e-4672-935c-84cb4e9fc682 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:54.990551 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-28e8cf89-721e-4672-935c-84cb4e9fc682 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e73a60801b04fc7acc4260297fdd2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808cc3e5392b4bb7a80b154a60f69ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:54.998732 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-28e8cf89-721e-4672-935c-84cb4e9fc682 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] 10.222.0.16 "GET /compute/v2.1/servers/31bf9c76-adbe-4c58-8d9e-f332e36f86db" status: 200 len: 1265 microversion: 2.1 time: 0.174183 Oct 31 19:23:54.999268 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 223/440] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:23:54 2022] GET /compute/v2.1/servers/31bf9c76-adbe-4c58-8d9e-f332e36f86db => generated 1265 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:23:55.131747 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-b243e88c-9449-4075-a4f4-533371fa18af tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:23:55.132430 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-b243e88c-9449-4075-a4f4-533371fa18af tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 24ad6e3e-6043-4eff-afb4-0c6039e825fa] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:23:55.139380 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-b243e88c-9449-4075-a4f4-533371fa18af tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:55.139874 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-b243e88c-9449-4075-a4f4-533371fa18af tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:55.140349 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-b243e88c-9449-4075-a4f4-533371fa18af tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:55.141048 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-b243e88c-9449-4075-a4f4-533371fa18af tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:55.141505 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-b243e88c-9449-4075-a4f4-533371fa18af tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:55.141954 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-b243e88c-9449-4075-a4f4-533371fa18af tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:55.309388 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-b243e88c-9449-4075-a4f4-533371fa18af tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:55.320208 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-b243e88c-9449-4075-a4f4-533371fa18af tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:55.321671 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-b243e88c-9449-4075-a4f4-533371fa18af tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:55.322840 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-b243e88c-9449-4075-a4f4-533371fa18af tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa" status: 200 len: 1809 microversion: 2.20 time: 0.195479 Oct 31 19:23:55.337318 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 218/441] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 31 19:23:55 2022] GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa => generated 1809 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 19:23:56.021831 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-8cb04f3d-4732-4865-8afd-6c3a611da60f tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:23:56.026134 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-8cb04f3d-4732-4865-8afd-6c3a611da60f tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] [instance: 31bf9c76-adbe-4c58-8d9e-f332e36f86db] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:23:56.029220 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-8cb04f3d-4732-4865-8afd-6c3a611da60f tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:56.029910 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-8cb04f3d-4732-4865-8afd-6c3a611da60f tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:56.031160 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-8cb04f3d-4732-4865-8afd-6c3a611da60f tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:56.032287 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-8cb04f3d-4732-4865-8afd-6c3a611da60f tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:56.032902 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-8cb04f3d-4732-4865-8afd-6c3a611da60f tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:56.033477 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-8cb04f3d-4732-4865-8afd-6c3a611da60f tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:56.242264 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-8cb04f3d-4732-4865-8afd-6c3a611da60f tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e73a60801b04fc7acc4260297fdd2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808cc3e5392b4bb7a80b154a60f69ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:56.251948 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-8cb04f3d-4732-4865-8afd-6c3a611da60f tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] 10.222.0.16 "GET /compute/v2.1/servers/31bf9c76-adbe-4c58-8d9e-f332e36f86db" status: 200 len: 1265 microversion: 2.1 time: 0.233847 Oct 31 19:23:56.253056 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 224/442] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:23:56 2022] GET /compute/v2.1/servers/31bf9c76-adbe-4c58-8d9e-f332e36f86db => generated 1265 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:23:56.348066 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-3ac7c340-db65-4e6c-91be-46a1e0e88ca5 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:23:56.348684 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-3ac7c340-db65-4e6c-91be-46a1e0e88ca5 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 24ad6e3e-6043-4eff-afb4-0c6039e825fa] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:23:56.356178 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-3ac7c340-db65-4e6c-91be-46a1e0e88ca5 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:56.356668 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-3ac7c340-db65-4e6c-91be-46a1e0e88ca5 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:56.357133 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-3ac7c340-db65-4e6c-91be-46a1e0e88ca5 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:56.357946 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-3ac7c340-db65-4e6c-91be-46a1e0e88ca5 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:56.358413 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-3ac7c340-db65-4e6c-91be-46a1e0e88ca5 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:56.359384 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-3ac7c340-db65-4e6c-91be-46a1e0e88ca5 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:56.564152 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-3ac7c340-db65-4e6c-91be-46a1e0e88ca5 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:56.574087 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-3ac7c340-db65-4e6c-91be-46a1e0e88ca5 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:56.575782 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-3ac7c340-db65-4e6c-91be-46a1e0e88ca5 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:56.577080 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-3ac7c340-db65-4e6c-91be-46a1e0e88ca5 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa" status: 200 len: 1809 microversion: 2.20 time: 0.233016 Oct 31 19:23:56.577821 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 219/443] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 31 19:23:56 2022] GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa => generated 1809 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 19:23:57.275978 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-b9cde9a2-51bd-4741-9865-b8c2dce78abf tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:23:57.276533 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-b9cde9a2-51bd-4741-9865-b8c2dce78abf tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] [instance: 31bf9c76-adbe-4c58-8d9e-f332e36f86db] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:23:57.283518 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-b9cde9a2-51bd-4741-9865-b8c2dce78abf tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:57.284010 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-b9cde9a2-51bd-4741-9865-b8c2dce78abf tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:57.284424 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-b9cde9a2-51bd-4741-9865-b8c2dce78abf tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:57.285113 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-b9cde9a2-51bd-4741-9865-b8c2dce78abf tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:57.285584 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-b9cde9a2-51bd-4741-9865-b8c2dce78abf tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:57.286023 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-b9cde9a2-51bd-4741-9865-b8c2dce78abf tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:57.437954 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-b9cde9a2-51bd-4741-9865-b8c2dce78abf tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e73a60801b04fc7acc4260297fdd2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808cc3e5392b4bb7a80b154a60f69ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:57.447315 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-b9cde9a2-51bd-4741-9865-b8c2dce78abf tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] 10.222.0.16 "GET /compute/v2.1/servers/31bf9c76-adbe-4c58-8d9e-f332e36f86db" status: 200 len: 1265 microversion: 2.1 time: 0.175238 Oct 31 19:23:57.447891 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 225/444] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:23:57 2022] GET /compute/v2.1/servers/31bf9c76-adbe-4c58-8d9e-f332e36f86db => generated 1265 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:23:57.609122 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-7ff7bc24-8abd-42cd-89d4-c251db0f267d tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:23:57.609800 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-7ff7bc24-8abd-42cd-89d4-c251db0f267d tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 24ad6e3e-6043-4eff-afb4-0c6039e825fa] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:23:57.616328 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-7ff7bc24-8abd-42cd-89d4-c251db0f267d tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:57.616814 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-7ff7bc24-8abd-42cd-89d4-c251db0f267d tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:57.617252 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-7ff7bc24-8abd-42cd-89d4-c251db0f267d tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:57.617975 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-7ff7bc24-8abd-42cd-89d4-c251db0f267d tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:57.618509 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-7ff7bc24-8abd-42cd-89d4-c251db0f267d tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:57.618852 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-7ff7bc24-8abd-42cd-89d4-c251db0f267d tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:57.752886 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-7ff7bc24-8abd-42cd-89d4-c251db0f267d tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:57.761907 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-7ff7bc24-8abd-42cd-89d4-c251db0f267d tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:57.763367 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-7ff7bc24-8abd-42cd-89d4-c251db0f267d tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:57.764546 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-7ff7bc24-8abd-42cd-89d4-c251db0f267d tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa" status: 200 len: 1809 microversion: 2.20 time: 0.159687 Oct 31 19:23:57.765157 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 220/445] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 31 19:23:57 2022] GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 19:23:58.470608 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-cd81b6c9-c8ec-427f-9dd2-fefbd5436cff tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:23:58.471218 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-cd81b6c9-c8ec-427f-9dd2-fefbd5436cff tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] [instance: 31bf9c76-adbe-4c58-8d9e-f332e36f86db] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:23:58.478916 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-cd81b6c9-c8ec-427f-9dd2-fefbd5436cff tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:58.479617 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-cd81b6c9-c8ec-427f-9dd2-fefbd5436cff tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:58.480182 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-cd81b6c9-c8ec-427f-9dd2-fefbd5436cff tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:58.480869 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-cd81b6c9-c8ec-427f-9dd2-fefbd5436cff tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:58.481317 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-cd81b6c9-c8ec-427f-9dd2-fefbd5436cff tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:58.481770 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-cd81b6c9-c8ec-427f-9dd2-fefbd5436cff tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:58.617496 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-cd81b6c9-c8ec-427f-9dd2-fefbd5436cff tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e73a60801b04fc7acc4260297fdd2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808cc3e5392b4bb7a80b154a60f69ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:58.626694 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-cd81b6c9-c8ec-427f-9dd2-fefbd5436cff tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] 10.222.0.16 "GET /compute/v2.1/servers/31bf9c76-adbe-4c58-8d9e-f332e36f86db" status: 200 len: 1265 microversion: 2.1 time: 0.161030 Oct 31 19:23:58.627266 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 226/446] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:23:58 2022] GET /compute/v2.1/servers/31bf9c76-adbe-4c58-8d9e-f332e36f86db => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:23:58.789880 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-d5b27887-fe14-47db-a25f-d26e1bb0ae31 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:23:58.790487 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-d5b27887-fe14-47db-a25f-d26e1bb0ae31 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 24ad6e3e-6043-4eff-afb4-0c6039e825fa] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:23:58.797680 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-d5b27887-fe14-47db-a25f-d26e1bb0ae31 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:58.798165 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-d5b27887-fe14-47db-a25f-d26e1bb0ae31 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:58.798603 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-d5b27887-fe14-47db-a25f-d26e1bb0ae31 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:58.799304 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-d5b27887-fe14-47db-a25f-d26e1bb0ae31 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:58.800224 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-d5b27887-fe14-47db-a25f-d26e1bb0ae31 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:58.800224 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-d5b27887-fe14-47db-a25f-d26e1bb0ae31 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:58.927022 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-d5b27887-fe14-47db-a25f-d26e1bb0ae31 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:58.936812 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-d5b27887-fe14-47db-a25f-d26e1bb0ae31 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:58.938462 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-d5b27887-fe14-47db-a25f-d26e1bb0ae31 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:58.939613 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-d5b27887-fe14-47db-a25f-d26e1bb0ae31 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa" status: 200 len: 1809 microversion: 2.20 time: 0.153692 Oct 31 19:23:58.940174 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 221/447] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 31 19:23:58 2022] GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa => generated 1809 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 19:23:59.651480 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-f392b214-aedf-4e9f-a3a0-a0b8680d08a9 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:23:59.653459 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-f392b214-aedf-4e9f-a3a0-a0b8680d08a9 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] [instance: 31bf9c76-adbe-4c58-8d9e-f332e36f86db] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:23:59.663050 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-f392b214-aedf-4e9f-a3a0-a0b8680d08a9 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:59.663528 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-f392b214-aedf-4e9f-a3a0-a0b8680d08a9 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:59.664211 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-f392b214-aedf-4e9f-a3a0-a0b8680d08a9 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:59.665145 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-f392b214-aedf-4e9f-a3a0-a0b8680d08a9 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:59.666300 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-f392b214-aedf-4e9f-a3a0-a0b8680d08a9 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:59.667800 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-f392b214-aedf-4e9f-a3a0-a0b8680d08a9 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:59.806884 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-f392b214-aedf-4e9f-a3a0-a0b8680d08a9 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e73a60801b04fc7acc4260297fdd2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808cc3e5392b4bb7a80b154a60f69ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:23:59.815017 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-f392b214-aedf-4e9f-a3a0-a0b8680d08a9 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] 10.222.0.16 "GET /compute/v2.1/servers/31bf9c76-adbe-4c58-8d9e-f332e36f86db" status: 200 len: 1265 microversion: 2.1 time: 0.169323 Oct 31 19:23:59.815580 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 227/448] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:23:59 2022] GET /compute/v2.1/servers/31bf9c76-adbe-4c58-8d9e-f332e36f86db => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:23:59.964347 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-47e3fad9-9bc7-4ff9-ba7b-02cb975c9774 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:23:59.964891 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-47e3fad9-9bc7-4ff9-ba7b-02cb975c9774 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 24ad6e3e-6043-4eff-afb4-0c6039e825fa] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:23:59.971369 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-47e3fad9-9bc7-4ff9-ba7b-02cb975c9774 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:59.971855 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-47e3fad9-9bc7-4ff9-ba7b-02cb975c9774 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:59.972290 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-47e3fad9-9bc7-4ff9-ba7b-02cb975c9774 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:23:59.972982 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-47e3fad9-9bc7-4ff9-ba7b-02cb975c9774 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:23:59.973437 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-47e3fad9-9bc7-4ff9-ba7b-02cb975c9774 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:23:59.973891 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-47e3fad9-9bc7-4ff9-ba7b-02cb975c9774 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:00.101656 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-47e3fad9-9bc7-4ff9-ba7b-02cb975c9774 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:24:00.110860 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-47e3fad9-9bc7-4ff9-ba7b-02cb975c9774 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:24:00.112318 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-47e3fad9-9bc7-4ff9-ba7b-02cb975c9774 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:24:00.113464 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-47e3fad9-9bc7-4ff9-ba7b-02cb975c9774 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa" status: 200 len: 1809 microversion: 2.20 time: 0.153155 Oct 31 19:24:00.114061 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 222/449] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 31 19:23:59 2022] GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa => generated 1809 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 19:24:00.838087 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-166fd517-984b-4600-b7a6-ef9328ce21b2 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:24:00.838780 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-166fd517-984b-4600-b7a6-ef9328ce21b2 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] [instance: 31bf9c76-adbe-4c58-8d9e-f332e36f86db] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:24:00.846093 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-166fd517-984b-4600-b7a6-ef9328ce21b2 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:00.846651 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-166fd517-984b-4600-b7a6-ef9328ce21b2 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:00.847151 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-166fd517-984b-4600-b7a6-ef9328ce21b2 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:00.847908 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-166fd517-984b-4600-b7a6-ef9328ce21b2 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:00.848436 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-166fd517-984b-4600-b7a6-ef9328ce21b2 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:00.848932 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-166fd517-984b-4600-b7a6-ef9328ce21b2 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:00.985060 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-166fd517-984b-4600-b7a6-ef9328ce21b2 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e73a60801b04fc7acc4260297fdd2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808cc3e5392b4bb7a80b154a60f69ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:24:00.992923 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-166fd517-984b-4600-b7a6-ef9328ce21b2 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] 10.222.0.16 "GET /compute/v2.1/servers/31bf9c76-adbe-4c58-8d9e-f332e36f86db" status: 200 len: 1265 microversion: 2.1 time: 0.158671 Oct 31 19:24:00.993586 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 228/450] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:24:00 2022] GET /compute/v2.1/servers/31bf9c76-adbe-4c58-8d9e-f332e36f86db => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:24:01.139556 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-f0a5d235-fcb6-4d67-a38c-ca9803d87d91 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:24:01.140702 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-f0a5d235-fcb6-4d67-a38c-ca9803d87d91 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 24ad6e3e-6043-4eff-afb4-0c6039e825fa] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:24:01.147163 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-f0a5d235-fcb6-4d67-a38c-ca9803d87d91 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:01.147653 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-f0a5d235-fcb6-4d67-a38c-ca9803d87d91 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:01.148087 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-f0a5d235-fcb6-4d67-a38c-ca9803d87d91 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:01.148782 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-f0a5d235-fcb6-4d67-a38c-ca9803d87d91 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:01.149236 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-f0a5d235-fcb6-4d67-a38c-ca9803d87d91 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:01.149687 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-f0a5d235-fcb6-4d67-a38c-ca9803d87d91 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:01.284422 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-f0a5d235-fcb6-4d67-a38c-ca9803d87d91 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:24:01.293828 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-f0a5d235-fcb6-4d67-a38c-ca9803d87d91 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:24:01.295582 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-f0a5d235-fcb6-4d67-a38c-ca9803d87d91 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:24:01.296810 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-f0a5d235-fcb6-4d67-a38c-ca9803d87d91 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa" status: 200 len: 1809 microversion: 2.20 time: 0.161545 Oct 31 19:24:01.297373 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 223/451] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 31 19:24:01 2022] GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 19:24:01.961504 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-4bb49021-9e8e-441c-b469-78166c59a425 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:24:01.962169 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-4bb49021-9e8e-441c-b469-78166c59a425 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] [instance: ecd39339-b802-43f3-aba3-432fd6e5387e] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:24:01.969207 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-4bb49021-9e8e-441c-b469-78166c59a425 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:01.969722 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-4bb49021-9e8e-441c-b469-78166c59a425 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:01.970158 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-4bb49021-9e8e-441c-b469-78166c59a425 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:01.970860 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-4bb49021-9e8e-441c-b469-78166c59a425 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:01.971314 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-4bb49021-9e8e-441c-b469-78166c59a425 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:01.971741 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-4bb49021-9e8e-441c-b469-78166c59a425 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:02.015576 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-5b8539e8-6b0c-4707-af6d-e2d5a515012d tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:24:02.016408 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-5b8539e8-6b0c-4707-af6d-e2d5a515012d tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] [instance: 31bf9c76-adbe-4c58-8d9e-f332e36f86db] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:24:02.023051 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-5b8539e8-6b0c-4707-af6d-e2d5a515012d tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:02.023745 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-5b8539e8-6b0c-4707-af6d-e2d5a515012d tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:02.024264 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-5b8539e8-6b0c-4707-af6d-e2d5a515012d tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:02.025184 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-5b8539e8-6b0c-4707-af6d-e2d5a515012d tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:02.026998 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-5b8539e8-6b0c-4707-af6d-e2d5a515012d tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:02.027504 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-5b8539e8-6b0c-4707-af6d-e2d5a515012d tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:02.117548 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-4bb49021-9e8e-441c-b469-78166c59a425 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b652cca4b94e188b7362606edabb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47ae1789d284a72bb71a6ffe55e7d8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:24:02.126391 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-4bb49021-9e8e-441c-b469-78166c59a425 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] 10.222.0.16 "GET /compute/v2.1/servers/ecd39339-b802-43f3-aba3-432fd6e5387e" status: 200 len: 1595 microversion: 2.1 time: 0.168725 Oct 31 19:24:02.127192 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 229/452] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:24:01 2022] GET /compute/v2.1/servers/ecd39339-b802-43f3-aba3-432fd6e5387e => generated 1595 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:24:02.174739 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-5b8539e8-6b0c-4707-af6d-e2d5a515012d tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e73a60801b04fc7acc4260297fdd2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808cc3e5392b4bb7a80b154a60f69ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:24:02.183590 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-5b8539e8-6b0c-4707-af6d-e2d5a515012d tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] 10.222.0.16 "GET /compute/v2.1/servers/31bf9c76-adbe-4c58-8d9e-f332e36f86db" status: 200 len: 1265 microversion: 2.1 time: 0.172047 Oct 31 19:24:02.184934 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 224/453] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:24:02 2022] GET /compute/v2.1/servers/31bf9c76-adbe-4c58-8d9e-f332e36f86db => generated 1265 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 19:24:02.322887 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-bbe95528-a511-4698-b760-635a2d05d0ee tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:24:02.323659 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-bbe95528-a511-4698-b760-635a2d05d0ee tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 24ad6e3e-6043-4eff-afb4-0c6039e825fa] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:24:02.331148 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-bbe95528-a511-4698-b760-635a2d05d0ee tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:02.331939 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-bbe95528-a511-4698-b760-635a2d05d0ee tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:02.332572 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-bbe95528-a511-4698-b760-635a2d05d0ee tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:02.333469 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-bbe95528-a511-4698-b760-635a2d05d0ee tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:02.334133 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-bbe95528-a511-4698-b760-635a2d05d0ee tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:02.334745 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-bbe95528-a511-4698-b760-635a2d05d0ee tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:02.339310 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG dbcounter [-] [118727] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:24:02.489027 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-bbe95528-a511-4698-b760-635a2d05d0ee tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:24:02.498683 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-bbe95528-a511-4698-b760-635a2d05d0ee tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:24:02.500218 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-bbe95528-a511-4698-b760-635a2d05d0ee tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:24:02.501652 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-bbe95528-a511-4698-b760-635a2d05d0ee tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa" status: 200 len: 1809 microversion: 2.20 time: 0.183039 Oct 31 19:24:02.502219 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 230/454] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 31 19:24:02 2022] GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa => generated 1809 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 19:24:03.206176 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-e580915e-4ef8-40ad-84f0-34d1ecdcd81f tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:24:03.206692 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-e580915e-4ef8-40ad-84f0-34d1ecdcd81f tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] [instance: 31bf9c76-adbe-4c58-8d9e-f332e36f86db] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:24:03.213821 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-e580915e-4ef8-40ad-84f0-34d1ecdcd81f tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:03.214303 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-e580915e-4ef8-40ad-84f0-34d1ecdcd81f tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:03.214796 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-e580915e-4ef8-40ad-84f0-34d1ecdcd81f tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:03.215400 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-e580915e-4ef8-40ad-84f0-34d1ecdcd81f tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:03.224226 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-e580915e-4ef8-40ad-84f0-34d1ecdcd81f tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:03.224673 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-e580915e-4ef8-40ad-84f0-34d1ecdcd81f tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:03.229124 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG dbcounter [-] [118726] Writing DB stats nova_cell1:SELECT=100 {{(pid=118726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:24:03.527696 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-501d0eaf-b2e0-4c1d-862f-198ebd164b41 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:24:03.528311 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-501d0eaf-b2e0-4c1d-862f-198ebd164b41 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 24ad6e3e-6043-4eff-afb4-0c6039e825fa] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:24:03.535767 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-501d0eaf-b2e0-4c1d-862f-198ebd164b41 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:03.536342 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-501d0eaf-b2e0-4c1d-862f-198ebd164b41 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:03.536926 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-501d0eaf-b2e0-4c1d-862f-198ebd164b41 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:03.537655 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-501d0eaf-b2e0-4c1d-862f-198ebd164b41 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:03.538119 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-501d0eaf-b2e0-4c1d-862f-198ebd164b41 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:03.538544 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-501d0eaf-b2e0-4c1d-862f-198ebd164b41 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:03.670116 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-e580915e-4ef8-40ad-84f0-34d1ecdcd81f tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e73a60801b04fc7acc4260297fdd2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808cc3e5392b4bb7a80b154a60f69ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:24:03.679483 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-e580915e-4ef8-40ad-84f0-34d1ecdcd81f tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] 10.222.0.16 "GET /compute/v2.1/servers/31bf9c76-adbe-4c58-8d9e-f332e36f86db" status: 200 len: 1265 microversion: 2.1 time: 0.476918 Oct 31 19:24:03.690785 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-501d0eaf-b2e0-4c1d-862f-198ebd164b41 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:24:03.693828 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 225/455] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:24:03 2022] GET /compute/v2.1/servers/31bf9c76-adbe-4c58-8d9e-f332e36f86db => generated 1265 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:24:03.702041 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-501d0eaf-b2e0-4c1d-862f-198ebd164b41 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:24:03.704101 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-501d0eaf-b2e0-4c1d-862f-198ebd164b41 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:24:03.705302 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-501d0eaf-b2e0-4c1d-862f-198ebd164b41 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa" status: 200 len: 1809 microversion: 2.20 time: 0.181738 Oct 31 19:24:03.705893 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 231/456] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 31 19:24:03 2022] GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa => generated 1809 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 19:24:03.828880 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [req-e209ddfd-da1e-46a0-b148-f7292a9bf503 req-79c50987-150d-4af9-8841-4ca4c6a5de29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31bf9c76-adbe-4c58-8d9e-f332e36f86db", "name": "network-vif-plugged", "status": "completed", "tag": "1bff50b4-bfa9-4d6c-bcae-38aef9bf842c"}]} {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:24:03.838843 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [req-e209ddfd-da1e-46a0-b148-f7292a9bf503 req-79c50987-150d-4af9-8841-4ca4c6a5de29 service nova] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:03.839340 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [req-e209ddfd-da1e-46a0-b148-f7292a9bf503 req-79c50987-150d-4af9-8841-4ca4c6a5de29 service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:03.839873 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [req-e209ddfd-da1e-46a0-b148-f7292a9bf503 req-79c50987-150d-4af9-8841-4ca4c6a5de29 service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:03.854840 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.compute.server_external_events [req-e209ddfd-da1e-46a0-b148-f7292a9bf503 req-79c50987-150d-4af9-8841-4ca4c6a5de29 service nova] Creating event network-vif-plugged:1bff50b4-bfa9-4d6c-bcae-38aef9bf842c for instance 31bf9c76-adbe-4c58-8d9e-f332e36f86db on hv-cinder-86309 Oct 31 19:24:03.860179 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [req-e209ddfd-da1e-46a0-b148-f7292a9bf503 req-79c50987-150d-4af9-8841-4ca4c6a5de29 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035526 Oct 31 19:24:03.860791 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 226/457] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 31 19:24:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:24:04.273176 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [req-6b63018d-1b5e-4eb2-8bf5-f878a1b49949 req-e75828a2-f6b0-4931-a56f-d4f7b3d10c8e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ecd39339-b802-43f3-aba3-432fd6e5387e", "tag": "02358090-76d2-46a6-9956-91d3a84a985a"}]} {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:24:04.278472 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG dbcounter [-] [118727] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=3 {{(pid=118727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:24:04.285471 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [req-6b63018d-1b5e-4eb2-8bf5-f878a1b49949 req-e75828a2-f6b0-4931-a56f-d4f7b3d10c8e service nova] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:04.286327 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [req-6b63018d-1b5e-4eb2-8bf5-f878a1b49949 req-e75828a2-f6b0-4931-a56f-d4f7b3d10c8e service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:04.286768 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [req-6b63018d-1b5e-4eb2-8bf5-f878a1b49949 req-e75828a2-f6b0-4931-a56f-d4f7b3d10c8e service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:04.300344 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.compute.server_external_events [req-6b63018d-1b5e-4eb2-8bf5-f878a1b49949 req-e75828a2-f6b0-4931-a56f-d4f7b3d10c8e service nova] Creating event network-changed:02358090-76d2-46a6-9956-91d3a84a985a for instance ecd39339-b802-43f3-aba3-432fd6e5387e on hv-cinder-86309 Oct 31 19:24:04.305375 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [req-6b63018d-1b5e-4eb2-8bf5-f878a1b49949 req-e75828a2-f6b0-4931-a56f-d4f7b3d10c8e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036828 Oct 31 19:24:04.306165 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 232/458] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 31 19:24:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 19:24:04.705202 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-8f13174f-0f59-470b-97cd-f5d180130a1b tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:24:04.706081 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-8f13174f-0f59-470b-97cd-f5d180130a1b tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] [instance: 31bf9c76-adbe-4c58-8d9e-f332e36f86db] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:24:04.717291 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-8f13174f-0f59-470b-97cd-f5d180130a1b tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:04.718547 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-8f13174f-0f59-470b-97cd-f5d180130a1b tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:04.719156 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-8f13174f-0f59-470b-97cd-f5d180130a1b tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:04.720427 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-8f13174f-0f59-470b-97cd-f5d180130a1b tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:04.721432 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-8f13174f-0f59-470b-97cd-f5d180130a1b tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:04.721963 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-8f13174f-0f59-470b-97cd-f5d180130a1b tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:04.732451 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-5d25705a-6ad8-4f4a-930a-7bcb7311ebb0 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:24:04.734939 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-5d25705a-6ad8-4f4a-930a-7bcb7311ebb0 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 24ad6e3e-6043-4eff-afb4-0c6039e825fa] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:24:04.744862 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-5d25705a-6ad8-4f4a-930a-7bcb7311ebb0 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:04.745358 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-5d25705a-6ad8-4f4a-930a-7bcb7311ebb0 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:04.745823 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-5d25705a-6ad8-4f4a-930a-7bcb7311ebb0 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:04.746588 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-5d25705a-6ad8-4f4a-930a-7bcb7311ebb0 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:04.750109 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-5d25705a-6ad8-4f4a-930a-7bcb7311ebb0 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:04.750578 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-5d25705a-6ad8-4f4a-930a-7bcb7311ebb0 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:04.939261 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-8f13174f-0f59-470b-97cd-f5d180130a1b tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e73a60801b04fc7acc4260297fdd2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808cc3e5392b4bb7a80b154a60f69ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:24:04.947846 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-8f13174f-0f59-470b-97cd-f5d180130a1b tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] 10.222.0.16 "GET /compute/v2.1/servers/31bf9c76-adbe-4c58-8d9e-f332e36f86db" status: 200 len: 1265 microversion: 2.1 time: 0.248591 Oct 31 19:24:04.947993 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-5d25705a-6ad8-4f4a-930a-7bcb7311ebb0 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:24:04.958142 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 227/459] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:24:04 2022] GET /compute/v2.1/servers/31bf9c76-adbe-4c58-8d9e-f332e36f86db => generated 1265 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:24:04.971375 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-5d25705a-6ad8-4f4a-930a-7bcb7311ebb0 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:24:04.972840 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-5d25705a-6ad8-4f4a-930a-7bcb7311ebb0 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:24:04.974675 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-5d25705a-6ad8-4f4a-930a-7bcb7311ebb0 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa" status: 200 len: 1809 microversion: 2.20 time: 0.246377 Oct 31 19:24:04.975415 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 233/460] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 31 19:24:04 2022] GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa => generated 1809 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 19:24:05.465873 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-7b2f3ac4-523e-4f1b-8d23-867275dd061a tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-477765809"}} {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:24:05.466338 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-7b2f3ac4-523e-4f1b-8d23-867275dd061a tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] [instance: ecd39339-b802-43f3-aba3-432fd6e5387e] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:24:05.472591 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-7b2f3ac4-523e-4f1b-8d23-867275dd061a tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:05.473071 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-7b2f3ac4-523e-4f1b-8d23-867275dd061a tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:05.473576 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-7b2f3ac4-523e-4f1b-8d23-867275dd061a tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:05.474326 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-7b2f3ac4-523e-4f1b-8d23-867275dd061a tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:05.474778 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-7b2f3ac4-523e-4f1b-8d23-867275dd061a tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:05.475403 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-7b2f3ac4-523e-4f1b-8d23-867275dd061a tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:05.613676 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.network.security_group_api [None req-7b2f3ac4-523e-4f1b-8d23-867275dd061a tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Adding security group 275ada28-2ceb-4fef-9ebc-74981cf09323 to port 02358090-76d2-46a6-9956-91d3a84a985a Oct 31 19:24:05.973850 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-84f98fff-5c26-4911-856e-38b582a57f05 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:24:05.976062 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-84f98fff-5c26-4911-856e-38b582a57f05 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] [instance: 31bf9c76-adbe-4c58-8d9e-f332e36f86db] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:24:05.988183 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-84f98fff-5c26-4911-856e-38b582a57f05 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:05.989179 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-84f98fff-5c26-4911-856e-38b582a57f05 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:05.989900 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-84f98fff-5c26-4911-856e-38b582a57f05 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:05.990689 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-84f98fff-5c26-4911-856e-38b582a57f05 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:05.991236 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-84f98fff-5c26-4911-856e-38b582a57f05 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:05.991852 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-84f98fff-5c26-4911-856e-38b582a57f05 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:06.013897 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-7b2f3ac4-523e-4f1b-8d23-867275dd061a tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] 10.222.0.16 "POST /compute/v2.1/servers/ecd39339-b802-43f3-aba3-432fd6e5387e/action" status: 202 len: 0 microversion: 2.1 time: 0.551577 Oct 31 19:24:06.014855 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 228/461] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 31 19:24:05 2022] POST /compute/v2.1/servers/ecd39339-b802-43f3-aba3-432fd6e5387e/action => generated 0 bytes in 554 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 19:24:06.020660 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-e4a2dbc9-770e-46a3-8055-bab0be9a8c1f tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:24:06.021365 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-e4a2dbc9-770e-46a3-8055-bab0be9a8c1f tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 24ad6e3e-6043-4eff-afb4-0c6039e825fa] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:24:06.032860 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-e4a2dbc9-770e-46a3-8055-bab0be9a8c1f tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:06.034566 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-e4a2dbc9-770e-46a3-8055-bab0be9a8c1f tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:06.040159 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-e4a2dbc9-770e-46a3-8055-bab0be9a8c1f tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:06.041135 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-e4a2dbc9-770e-46a3-8055-bab0be9a8c1f tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:06.042111 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-e4a2dbc9-770e-46a3-8055-bab0be9a8c1f tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:06.042732 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-e4a2dbc9-770e-46a3-8055-bab0be9a8c1f tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:06.213422 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-84f98fff-5c26-4911-856e-38b582a57f05 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e73a60801b04fc7acc4260297fdd2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808cc3e5392b4bb7a80b154a60f69ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:24:06.228037 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-84f98fff-5c26-4911-856e-38b582a57f05 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] 10.222.0.16 "GET /compute/v2.1/servers/31bf9c76-adbe-4c58-8d9e-f332e36f86db" status: 200 len: 1265 microversion: 2.1 time: 0.258839 Oct 31 19:24:06.229912 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 234/462] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:24:05 2022] GET /compute/v2.1/servers/31bf9c76-adbe-4c58-8d9e-f332e36f86db => generated 1265 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:24:06.239045 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-1982540d-ef2e-4a54-8a4c-a7e06dd053b2 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:24:06.240664 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-1982540d-ef2e-4a54-8a4c-a7e06dd053b2 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] [instance: ecd39339-b802-43f3-aba3-432fd6e5387e] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:24:06.251332 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-1982540d-ef2e-4a54-8a4c-a7e06dd053b2 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:06.252696 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-1982540d-ef2e-4a54-8a4c-a7e06dd053b2 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:06.253467 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-1982540d-ef2e-4a54-8a4c-a7e06dd053b2 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:06.254556 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-1982540d-ef2e-4a54-8a4c-a7e06dd053b2 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:06.255181 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-1982540d-ef2e-4a54-8a4c-a7e06dd053b2 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:06.255800 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-1982540d-ef2e-4a54-8a4c-a7e06dd053b2 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:06.257656 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-e4a2dbc9-770e-46a3-8055-bab0be9a8c1f tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:24:06.267557 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-e4a2dbc9-770e-46a3-8055-bab0be9a8c1f tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:24:06.270078 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-e4a2dbc9-770e-46a3-8055-bab0be9a8c1f tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:24:06.272215 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-e4a2dbc9-770e-46a3-8055-bab0be9a8c1f tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa" status: 200 len: 1809 microversion: 2.20 time: 0.256289 Oct 31 19:24:06.273896 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 229/463] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 31 19:24:06 2022] GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa => generated 1809 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 19:24:06.325053 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [req-d9458fc2-27de-40d2-b44a-130f3b4b8e37 req-e6c09c8d-1a10-4195-aa8f-bfdd2f5d04e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ecd39339-b802-43f3-aba3-432fd6e5387e", "tag": "02358090-76d2-46a6-9956-91d3a84a985a"}]} {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:24:06.340115 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [req-d9458fc2-27de-40d2-b44a-130f3b4b8e37 req-e6c09c8d-1a10-4195-aa8f-bfdd2f5d04e4 service nova] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:06.340734 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [req-d9458fc2-27de-40d2-b44a-130f3b4b8e37 req-e6c09c8d-1a10-4195-aa8f-bfdd2f5d04e4 service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:06.342185 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [req-d9458fc2-27de-40d2-b44a-130f3b4b8e37 req-e6c09c8d-1a10-4195-aa8f-bfdd2f5d04e4 service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:06.362261 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.compute.server_external_events [req-d9458fc2-27de-40d2-b44a-130f3b4b8e37 req-e6c09c8d-1a10-4195-aa8f-bfdd2f5d04e4 service nova] Creating event network-changed:02358090-76d2-46a6-9956-91d3a84a985a for instance ecd39339-b802-43f3-aba3-432fd6e5387e on hv-cinder-86309 Oct 31 19:24:06.369258 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [req-d9458fc2-27de-40d2-b44a-130f3b4b8e37 req-e6c09c8d-1a10-4195-aa8f-bfdd2f5d04e4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050482 Oct 31 19:24:06.370256 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 230/464] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 31 19:24:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:24:06.500960 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-1982540d-ef2e-4a54-8a4c-a7e06dd053b2 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b652cca4b94e188b7362606edabb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47ae1789d284a72bb71a6ffe55e7d8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:24:06.510584 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-1982540d-ef2e-4a54-8a4c-a7e06dd053b2 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] 10.222.0.16 "GET /compute/v2.1/servers/ecd39339-b802-43f3-aba3-432fd6e5387e" status: 200 len: 1641 microversion: 2.1 time: 0.279426 Oct 31 19:24:06.517993 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 235/465] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:24:06 2022] GET /compute/v2.1/servers/ecd39339-b802-43f3-aba3-432fd6e5387e => generated 1641 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:24:07.253837 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-a886a2f6-0817-408c-a9e2-5f9f30fd9ce6 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:24:07.254586 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-a886a2f6-0817-408c-a9e2-5f9f30fd9ce6 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] [instance: 31bf9c76-adbe-4c58-8d9e-f332e36f86db] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:24:07.261781 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-a886a2f6-0817-408c-a9e2-5f9f30fd9ce6 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:07.262390 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-a886a2f6-0817-408c-a9e2-5f9f30fd9ce6 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:07.262826 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-a886a2f6-0817-408c-a9e2-5f9f30fd9ce6 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:07.263727 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-a886a2f6-0817-408c-a9e2-5f9f30fd9ce6 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:07.264531 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-a886a2f6-0817-408c-a9e2-5f9f30fd9ce6 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:07.265522 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-a886a2f6-0817-408c-a9e2-5f9f30fd9ce6 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:07.299662 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-73cad5b6-b9ae-4917-a7ca-708e4703f19b tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:24:07.300268 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-73cad5b6-b9ae-4917-a7ca-708e4703f19b tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 24ad6e3e-6043-4eff-afb4-0c6039e825fa] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:24:07.306873 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-73cad5b6-b9ae-4917-a7ca-708e4703f19b tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:07.307351 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-73cad5b6-b9ae-4917-a7ca-708e4703f19b tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:07.307990 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-73cad5b6-b9ae-4917-a7ca-708e4703f19b tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:07.308683 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-73cad5b6-b9ae-4917-a7ca-708e4703f19b tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:07.309132 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-73cad5b6-b9ae-4917-a7ca-708e4703f19b tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:07.309760 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-73cad5b6-b9ae-4917-a7ca-708e4703f19b tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:07.403963 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-a886a2f6-0817-408c-a9e2-5f9f30fd9ce6 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e73a60801b04fc7acc4260297fdd2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808cc3e5392b4bb7a80b154a60f69ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:24:07.411577 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-a886a2f6-0817-408c-a9e2-5f9f30fd9ce6 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] 10.222.0.16 "GET /compute/v2.1/servers/31bf9c76-adbe-4c58-8d9e-f332e36f86db" status: 200 len: 1451 microversion: 2.1 time: 0.163811 Oct 31 19:24:07.412141 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 231/466] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:24:07 2022] GET /compute/v2.1/servers/31bf9c76-adbe-4c58-8d9e-f332e36f86db => generated 1451 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:24:07.433479 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-77b35b59-c5d7-4290-9e1a-1c4c474463f7 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:24:07.434118 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-77b35b59-c5d7-4290-9e1a-1c4c474463f7 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] [instance: 31bf9c76-adbe-4c58-8d9e-f332e36f86db] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:24:07.440511 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-77b35b59-c5d7-4290-9e1a-1c4c474463f7 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:07.440995 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-77b35b59-c5d7-4290-9e1a-1c4c474463f7 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:07.441386 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-77b35b59-c5d7-4290-9e1a-1c4c474463f7 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:07.442103 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-77b35b59-c5d7-4290-9e1a-1c4c474463f7 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:07.442557 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-77b35b59-c5d7-4290-9e1a-1c4c474463f7 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:07.442977 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-77b35b59-c5d7-4290-9e1a-1c4c474463f7 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:07.491090 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-73cad5b6-b9ae-4917-a7ca-708e4703f19b tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:24:07.504403 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-73cad5b6-b9ae-4917-a7ca-708e4703f19b tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:24:07.505958 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-73cad5b6-b9ae-4917-a7ca-708e4703f19b tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:24:07.507147 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-73cad5b6-b9ae-4917-a7ca-708e4703f19b tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa" status: 200 len: 1809 microversion: 2.20 time: 0.211352 Oct 31 19:24:07.508115 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 236/467] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 31 19:24:07 2022] GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa => generated 1809 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 19:24:07.596401 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-77b35b59-c5d7-4290-9e1a-1c4c474463f7 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e73a60801b04fc7acc4260297fdd2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808cc3e5392b4bb7a80b154a60f69ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:24:07.609816 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-77b35b59-c5d7-4290-9e1a-1c4c474463f7 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] 10.222.0.16 "GET /compute/v2.1/servers/31bf9c76-adbe-4c58-8d9e-f332e36f86db" status: 200 len: 1451 microversion: 2.1 time: 0.179899 Oct 31 19:24:07.613594 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 232/468] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:24:07 2022] GET /compute/v2.1/servers/31bf9c76-adbe-4c58-8d9e-f332e36f86db => generated 1451 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 19:24:08.537176 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-e2e35518-d776-4aac-b0e4-de6cd55774de tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:24:08.537936 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-e2e35518-d776-4aac-b0e4-de6cd55774de tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 24ad6e3e-6043-4eff-afb4-0c6039e825fa] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:24:08.552255 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-e2e35518-d776-4aac-b0e4-de6cd55774de tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:08.552751 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-e2e35518-d776-4aac-b0e4-de6cd55774de tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:08.553282 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-e2e35518-d776-4aac-b0e4-de6cd55774de tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:08.554084 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-e2e35518-d776-4aac-b0e4-de6cd55774de tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:08.554624 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-e2e35518-d776-4aac-b0e4-de6cd55774de tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:08.555207 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-e2e35518-d776-4aac-b0e4-de6cd55774de tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:08.730479 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-e2e35518-d776-4aac-b0e4-de6cd55774de tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:24:08.741558 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-e2e35518-d776-4aac-b0e4-de6cd55774de tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:24:08.743436 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-e2e35518-d776-4aac-b0e4-de6cd55774de tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:24:08.744861 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-e2e35518-d776-4aac-b0e4-de6cd55774de tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa" status: 200 len: 1809 microversion: 2.20 time: 0.211473 Oct 31 19:24:08.745523 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 237/469] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 31 19:24:08 2022] GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa => generated 1809 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 19:24:09.735743 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [req-4c8c369b-86b3-4e3b-9fdc-bbff5757cbc8 req-a1a6778b-4340-46fd-87f5-dd3bcff91c13 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31bf9c76-adbe-4c58-8d9e-f332e36f86db", "tag": "1bff50b4-bfa9-4d6c-bcae-38aef9bf842c"}]} {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:24:09.749092 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [req-4c8c369b-86b3-4e3b-9fdc-bbff5757cbc8 req-a1a6778b-4340-46fd-87f5-dd3bcff91c13 service nova] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:09.750457 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [req-4c8c369b-86b3-4e3b-9fdc-bbff5757cbc8 req-a1a6778b-4340-46fd-87f5-dd3bcff91c13 service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:09.751478 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [req-4c8c369b-86b3-4e3b-9fdc-bbff5757cbc8 req-a1a6778b-4340-46fd-87f5-dd3bcff91c13 service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:09.764367 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.compute.server_external_events [req-4c8c369b-86b3-4e3b-9fdc-bbff5757cbc8 req-a1a6778b-4340-46fd-87f5-dd3bcff91c13 service nova] Creating event network-changed:1bff50b4-bfa9-4d6c-bcae-38aef9bf842c for instance 31bf9c76-adbe-4c58-8d9e-f332e36f86db on hv-cinder-86309 Oct 31 19:24:09.772536 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [req-4c8c369b-86b3-4e3b-9fdc-bbff5757cbc8 req-a1a6778b-4340-46fd-87f5-dd3bcff91c13 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041175 Oct 31 19:24:09.774329 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 233/470] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 31 19:24:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:24:09.776353 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-6cbe35a1-91ca-4f35-882e-61957ae0f849 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:24:09.777031 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-6cbe35a1-91ca-4f35-882e-61957ae0f849 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 24ad6e3e-6043-4eff-afb4-0c6039e825fa] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:24:09.789761 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-6cbe35a1-91ca-4f35-882e-61957ae0f849 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:09.790320 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-6cbe35a1-91ca-4f35-882e-61957ae0f849 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:09.790960 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-6cbe35a1-91ca-4f35-882e-61957ae0f849 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:09.792948 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-6cbe35a1-91ca-4f35-882e-61957ae0f849 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:09.793868 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-6cbe35a1-91ca-4f35-882e-61957ae0f849 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:09.794606 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-6cbe35a1-91ca-4f35-882e-61957ae0f849 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:10.057470 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-6cbe35a1-91ca-4f35-882e-61957ae0f849 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:24:10.066709 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-6cbe35a1-91ca-4f35-882e-61957ae0f849 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:24:10.068161 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-6cbe35a1-91ca-4f35-882e-61957ae0f849 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:24:10.069317 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-6cbe35a1-91ca-4f35-882e-61957ae0f849 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa" status: 200 len: 1809 microversion: 2.20 time: 0.298421 Oct 31 19:24:10.069905 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 238/471] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 31 19:24:09 2022] GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa => generated 1809 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 19:24:10.224982 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [req-4fad9a7f-b15b-4b52-84d4-2c84db756108 req-442d6d74-b0cf-478c-9d54-4c22280c2c14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24ad6e3e-6043-4eff-afb4-0c6039e825fa", "name": "network-vif-plugged", "status": "completed", "tag": "3807af14-6f9a-4bcc-86d0-c9961d4697ae"}]} {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:24:10.232710 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG dbcounter [-] [118726] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=1 {{(pid=118726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:24:10.237986 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [req-4fad9a7f-b15b-4b52-84d4-2c84db756108 req-442d6d74-b0cf-478c-9d54-4c22280c2c14 service nova] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:10.238576 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [req-4fad9a7f-b15b-4b52-84d4-2c84db756108 req-442d6d74-b0cf-478c-9d54-4c22280c2c14 service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:10.239270 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [req-4fad9a7f-b15b-4b52-84d4-2c84db756108 req-442d6d74-b0cf-478c-9d54-4c22280c2c14 service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:10.270222 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.compute.server_external_events [req-4fad9a7f-b15b-4b52-84d4-2c84db756108 req-442d6d74-b0cf-478c-9d54-4c22280c2c14 service nova] Creating event network-vif-plugged:3807af14-6f9a-4bcc-86d0-c9961d4697ae for instance 24ad6e3e-6043-4eff-afb4-0c6039e825fa on hv-cinder-86309 Oct 31 19:24:10.277829 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [req-4fad9a7f-b15b-4b52-84d4-2c84db756108 req-442d6d74-b0cf-478c-9d54-4c22280c2c14 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065994 Oct 31 19:24:10.277829 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 234/472] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 31 19:24:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:24:11.098782 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-051f60a4-95f5-42f1-ab72-42529b31df2c tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:24:11.099392 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-051f60a4-95f5-42f1-ab72-42529b31df2c tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 24ad6e3e-6043-4eff-afb4-0c6039e825fa] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:24:11.105872 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-051f60a4-95f5-42f1-ab72-42529b31df2c tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:11.106372 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-051f60a4-95f5-42f1-ab72-42529b31df2c tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:11.106808 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-051f60a4-95f5-42f1-ab72-42529b31df2c tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:11.107501 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-051f60a4-95f5-42f1-ab72-42529b31df2c tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:11.108013 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-051f60a4-95f5-42f1-ab72-42529b31df2c tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:11.109007 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-051f60a4-95f5-42f1-ab72-42529b31df2c tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:11.242196 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-051f60a4-95f5-42f1-ab72-42529b31df2c tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:24:11.250938 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-051f60a4-95f5-42f1-ab72-42529b31df2c tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:24:11.252374 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-051f60a4-95f5-42f1-ab72-42529b31df2c tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:24:11.253521 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-051f60a4-95f5-42f1-ab72-42529b31df2c tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa" status: 200 len: 1809 microversion: 2.20 time: 0.158726 Oct 31 19:24:11.254118 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 239/473] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 31 19:24:11 2022] GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 19:24:11.393984 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-56c39f3a-0cd1-4e26-ae09-4f8f4be274b4 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-683481223", "imageRef": "a9795ee0-6722-4e1e-8fc8-a6c2e68f3049", "flavorRef": "452", "networks": [{"uuid": "31f7e77e-1dcb-4684-b3e9-e4a580efbeec"}]}} {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:24:11.456365 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.network.neutron [None req-56c39f3a-0cd1-4e26-ae09-4f8f4be274b4 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] validate_networks() for [('31f7e77e-1dcb-4684-b3e9-e4a580efbeec', None, None, None, None, None)] {{(pid=118726) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 19:24:11.800939 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.virt.hardware [None req-56c39f3a-0cd1-4e26-ae09-4f8f4be274b4 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Flavor limits 0:0:0 {{(pid=118726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 19:24:11.801375 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.virt.hardware [None req-56c39f3a-0cd1-4e26-ae09-4f8f4be274b4 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Image limits 0:0:0 {{(pid=118726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 19:24:11.802214 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.virt.hardware [None req-56c39f3a-0cd1-4e26-ae09-4f8f4be274b4 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Flavor pref 0:0:0 {{(pid=118726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 19:24:11.802583 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.virt.hardware [None req-56c39f3a-0cd1-4e26-ae09-4f8f4be274b4 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Image pref 0:0:0 {{(pid=118726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 19:24:11.803015 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.virt.hardware [None req-56c39f3a-0cd1-4e26-ae09-4f8f4be274b4 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 19:24:11.812833 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-56c39f3a-0cd1-4e26-ae09-4f8f4be274b4 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:11.813280 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-56c39f3a-0cd1-4e26-ae09-4f8f4be274b4 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:11.813747 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-56c39f3a-0cd1-4e26-ae09-4f8f4be274b4 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:11.814503 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-56c39f3a-0cd1-4e26-ae09-4f8f4be274b4 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:11.814953 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-56c39f3a-0cd1-4e26-ae09-4f8f4be274b4 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:11.815399 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-56c39f3a-0cd1-4e26-ae09-4f8f4be274b4 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:11.832710 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.quota [None req-56c39f3a-0cd1-4e26-ae09-4f8f4be274b4 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Getting quotas for project b2956107c4664ccd8a7517a707982d1b. Resources: {'instances', 'ram', 'cores'} {{(pid=118726) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 19:24:11.836593 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.quota [None req-56c39f3a-0cd1-4e26-ae09-4f8f4be274b4 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Getting quotas for user 5cbeda8236874f2ca69a6638c626e466 and project b2956107c4664ccd8a7517a707982d1b. Resources: {'instances', 'ram', 'cores'} {{(pid=118726) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 19:24:11.847335 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-56c39f3a-0cd1-4e26-ae09-4f8f4be274b4 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Going to run 1 instances... {{(pid=118726) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 19:24:11.849729 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-56c39f3a-0cd1-4e26-ae09-4f8f4be274b4 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] [instance: a61dd73b-990e-4832-8528-41baab5db81a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9795ee0-6722-4e1e-8fc8-a6c2e68f3049',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118726) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 19:24:11.895796 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-56c39f3a-0cd1-4e26-ae09-4f8f4be274b4 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.506753 Oct 31 19:24:11.896437 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 235/474] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 31 19:24:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 508 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 19:24:11.907518 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-9f044525-94ad-4a08-848d-0432390f5084 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:24:11.908230 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-9f044525-94ad-4a08-848d-0432390f5084 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] [instance: a61dd73b-990e-4832-8528-41baab5db81a] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:24:11.966058 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-9f044525-94ad-4a08-848d-0432390f5084 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbeda8236874f2ca69a6638c626e466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2956107c4664ccd8a7517a707982d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:24:11.975262 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-9f044525-94ad-4a08-848d-0432390f5084 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] 10.222.0.16 "GET /compute/v2.1/servers/a61dd73b-990e-4832-8528-41baab5db81a" status: 200 len: 1218 microversion: 2.1 time: 0.071514 Oct 31 19:24:11.975860 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 240/475] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:24:11 2022] GET /compute/v2.1/servers/a61dd73b-990e-4832-8528-41baab5db81a => generated 1218 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:24:12.279899 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-a2da59b5-2fbd-4a83-8966-6d5ba291a060 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:24:12.280628 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-a2da59b5-2fbd-4a83-8966-6d5ba291a060 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 24ad6e3e-6043-4eff-afb4-0c6039e825fa] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:24:12.287169 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-a2da59b5-2fbd-4a83-8966-6d5ba291a060 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:12.287651 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-a2da59b5-2fbd-4a83-8966-6d5ba291a060 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:12.288087 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-a2da59b5-2fbd-4a83-8966-6d5ba291a060 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:12.288775 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-a2da59b5-2fbd-4a83-8966-6d5ba291a060 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:12.289229 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-a2da59b5-2fbd-4a83-8966-6d5ba291a060 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:12.289686 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-a2da59b5-2fbd-4a83-8966-6d5ba291a060 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:12.425853 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-a2da59b5-2fbd-4a83-8966-6d5ba291a060 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:24:12.434941 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-a2da59b5-2fbd-4a83-8966-6d5ba291a060 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:24:12.436401 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-a2da59b5-2fbd-4a83-8966-6d5ba291a060 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:24:12.437536 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-a2da59b5-2fbd-4a83-8966-6d5ba291a060 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa" status: 200 len: 1809 microversion: 2.20 time: 0.162048 Oct 31 19:24:12.438124 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 236/476] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 31 19:24:12 2022] GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 19:24:12.999529 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-a6e6d40f-f666-4960-8465-57f98e679fe6 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:24:13.000141 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-a6e6d40f-f666-4960-8465-57f98e679fe6 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] [instance: a61dd73b-990e-4832-8528-41baab5db81a] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:24:13.006842 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-a6e6d40f-f666-4960-8465-57f98e679fe6 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:13.007505 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-a6e6d40f-f666-4960-8465-57f98e679fe6 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:13.007932 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-a6e6d40f-f666-4960-8465-57f98e679fe6 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:13.008619 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-a6e6d40f-f666-4960-8465-57f98e679fe6 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:13.009068 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-a6e6d40f-f666-4960-8465-57f98e679fe6 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:13.009481 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-a6e6d40f-f666-4960-8465-57f98e679fe6 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:13.081411 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-a6e6d40f-f666-4960-8465-57f98e679fe6 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbeda8236874f2ca69a6638c626e466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2956107c4664ccd8a7517a707982d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:24:13.090633 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-a6e6d40f-f666-4960-8465-57f98e679fe6 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] 10.222.0.16 "GET /compute/v2.1/servers/a61dd73b-990e-4832-8528-41baab5db81a" status: 200 len: 1214 microversion: 2.1 time: 0.096054 Oct 31 19:24:13.091538 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 241/477] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:24:12 2022] GET /compute/v2.1/servers/a61dd73b-990e-4832-8528-41baab5db81a => generated 1214 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:24:13.466181 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-9592124a-ce8b-4813-8f1a-1fcf72d6a8f4 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:24:13.467013 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-9592124a-ce8b-4813-8f1a-1fcf72d6a8f4 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 24ad6e3e-6043-4eff-afb4-0c6039e825fa] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:24:13.474593 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-9592124a-ce8b-4813-8f1a-1fcf72d6a8f4 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:13.475019 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-9592124a-ce8b-4813-8f1a-1fcf72d6a8f4 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:13.475446 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-9592124a-ce8b-4813-8f1a-1fcf72d6a8f4 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:13.476310 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-9592124a-ce8b-4813-8f1a-1fcf72d6a8f4 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:13.476629 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-9592124a-ce8b-4813-8f1a-1fcf72d6a8f4 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:13.477288 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-9592124a-ce8b-4813-8f1a-1fcf72d6a8f4 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:13.615097 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-9592124a-ce8b-4813-8f1a-1fcf72d6a8f4 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:24:13.623605 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-9592124a-ce8b-4813-8f1a-1fcf72d6a8f4 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:24:13.625114 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-9592124a-ce8b-4813-8f1a-1fcf72d6a8f4 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:24:13.626283 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-9592124a-ce8b-4813-8f1a-1fcf72d6a8f4 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa" status: 200 len: 1809 microversion: 2.20 time: 0.165178 Oct 31 19:24:13.626838 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 237/478] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 31 19:24:13 2022] GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa => generated 1809 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 19:24:14.114510 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-c36f09e2-b139-4b69-a02f-6c021cacc221 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:24:14.115689 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-c36f09e2-b139-4b69-a02f-6c021cacc221 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] [instance: a61dd73b-990e-4832-8528-41baab5db81a] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:24:14.123130 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-c36f09e2-b139-4b69-a02f-6c021cacc221 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:14.123312 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-c36f09e2-b139-4b69-a02f-6c021cacc221 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:14.124449 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-c36f09e2-b139-4b69-a02f-6c021cacc221 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:14.125151 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-c36f09e2-b139-4b69-a02f-6c021cacc221 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:14.125624 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-c36f09e2-b139-4b69-a02f-6c021cacc221 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:14.126049 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-c36f09e2-b139-4b69-a02f-6c021cacc221 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:14.219866 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-c36f09e2-b139-4b69-a02f-6c021cacc221 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbeda8236874f2ca69a6638c626e466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2956107c4664ccd8a7517a707982d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:24:14.227428 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-c36f09e2-b139-4b69-a02f-6c021cacc221 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] 10.222.0.16 "GET /compute/v2.1/servers/a61dd73b-990e-4832-8528-41baab5db81a" status: 200 len: 1276 microversion: 2.1 time: 0.117069 Oct 31 19:24:14.228004 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 242/479] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:24:14 2022] GET /compute/v2.1/servers/a61dd73b-990e-4832-8528-41baab5db81a => generated 1276 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:24:14.652077 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-9036fd59-e79c-4153-822d-a2cc9bbd924d tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:24:14.652688 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-9036fd59-e79c-4153-822d-a2cc9bbd924d tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 24ad6e3e-6043-4eff-afb4-0c6039e825fa] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:24:14.659681 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-9036fd59-e79c-4153-822d-a2cc9bbd924d tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:14.660274 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-9036fd59-e79c-4153-822d-a2cc9bbd924d tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:14.660800 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-9036fd59-e79c-4153-822d-a2cc9bbd924d tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:14.661504 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-9036fd59-e79c-4153-822d-a2cc9bbd924d tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:14.661985 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-9036fd59-e79c-4153-822d-a2cc9bbd924d tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:14.662411 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-9036fd59-e79c-4153-822d-a2cc9bbd924d tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:14.793888 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-9036fd59-e79c-4153-822d-a2cc9bbd924d tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:24:14.804329 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-9036fd59-e79c-4153-822d-a2cc9bbd924d tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:24:14.805808 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-9036fd59-e79c-4153-822d-a2cc9bbd924d tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:24:14.806975 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-9036fd59-e79c-4153-822d-a2cc9bbd924d tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa" status: 200 len: 1796 microversion: 2.20 time: 0.159027 Oct 31 19:24:14.807541 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 238/480] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 31 19:24:14 2022] GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa => generated 1796 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 19:24:15.142433 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [req-afdb288a-7515-4b64-8ba6-3fe2fa36a6d2 req-f0243518-ad15-465c-9fc3-f1449b77e0d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a61dd73b-990e-4832-8528-41baab5db81a", "tag": "2b55714e-6a22-4127-82d1-55a0ecf6a90f"}]} {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:24:15.153059 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [req-afdb288a-7515-4b64-8ba6-3fe2fa36a6d2 req-f0243518-ad15-465c-9fc3-f1449b77e0d0 service nova] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:15.153563 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [req-afdb288a-7515-4b64-8ba6-3fe2fa36a6d2 req-f0243518-ad15-465c-9fc3-f1449b77e0d0 service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:15.154076 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [req-afdb288a-7515-4b64-8ba6-3fe2fa36a6d2 req-f0243518-ad15-465c-9fc3-f1449b77e0d0 service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:15.165553 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.compute.server_external_events [req-afdb288a-7515-4b64-8ba6-3fe2fa36a6d2 req-f0243518-ad15-465c-9fc3-f1449b77e0d0 service nova] Creating event network-changed:2b55714e-6a22-4127-82d1-55a0ecf6a90f for instance a61dd73b-990e-4832-8528-41baab5db81a on hv-cinder-86309 Oct 31 19:24:15.170659 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [req-afdb288a-7515-4b64-8ba6-3fe2fa36a6d2 req-f0243518-ad15-465c-9fc3-f1449b77e0d0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032331 Oct 31 19:24:15.171322 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 243/481] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 31 19:24:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:24:15.250946 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-fd5d2944-2bdc-4ed0-bbe1-2199546d66b2 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:24:15.251498 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-fd5d2944-2bdc-4ed0-bbe1-2199546d66b2 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] [instance: a61dd73b-990e-4832-8528-41baab5db81a] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:24:15.257751 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-fd5d2944-2bdc-4ed0-bbe1-2199546d66b2 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:15.258238 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-fd5d2944-2bdc-4ed0-bbe1-2199546d66b2 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:15.258673 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-fd5d2944-2bdc-4ed0-bbe1-2199546d66b2 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:15.259364 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-fd5d2944-2bdc-4ed0-bbe1-2199546d66b2 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:15.259819 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-fd5d2944-2bdc-4ed0-bbe1-2199546d66b2 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:15.260244 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-fd5d2944-2bdc-4ed0-bbe1-2199546d66b2 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:15.393278 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-fd5d2944-2bdc-4ed0-bbe1-2199546d66b2 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbeda8236874f2ca69a6638c626e466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2956107c4664ccd8a7517a707982d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:24:15.400916 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-fd5d2944-2bdc-4ed0-bbe1-2199546d66b2 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] 10.222.0.16 "GET /compute/v2.1/servers/a61dd73b-990e-4832-8528-41baab5db81a" status: 200 len: 1318 microversion: 2.1 time: 0.153873 Oct 31 19:24:15.401500 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 239/482] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:24:15 2022] GET /compute/v2.1/servers/a61dd73b-990e-4832-8528-41baab5db81a => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:24:16.425396 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-025aefcd-749b-49f8-b907-65aa2f77c001 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:24:16.426051 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-025aefcd-749b-49f8-b907-65aa2f77c001 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] [instance: a61dd73b-990e-4832-8528-41baab5db81a] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:24:16.432102 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-025aefcd-749b-49f8-b907-65aa2f77c001 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:16.432574 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-025aefcd-749b-49f8-b907-65aa2f77c001 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:16.433003 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-025aefcd-749b-49f8-b907-65aa2f77c001 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:16.433704 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-025aefcd-749b-49f8-b907-65aa2f77c001 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:16.434156 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-025aefcd-749b-49f8-b907-65aa2f77c001 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:16.434572 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-025aefcd-749b-49f8-b907-65aa2f77c001 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:16.565570 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-025aefcd-749b-49f8-b907-65aa2f77c001 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbeda8236874f2ca69a6638c626e466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2956107c4664ccd8a7517a707982d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:24:16.573161 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-025aefcd-749b-49f8-b907-65aa2f77c001 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] 10.222.0.16 "GET /compute/v2.1/servers/a61dd73b-990e-4832-8528-41baab5db81a" status: 200 len: 1318 microversion: 2.1 time: 0.153205 Oct 31 19:24:16.573752 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 244/483] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:24:16 2022] GET /compute/v2.1/servers/a61dd73b-990e-4832-8528-41baab5db81a => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:24:17.595910 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-bb2f56a7-3218-42fa-860d-a8a3dcb1f7af tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:24:17.596519 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-bb2f56a7-3218-42fa-860d-a8a3dcb1f7af tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] [instance: a61dd73b-990e-4832-8528-41baab5db81a] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:24:17.603665 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-bb2f56a7-3218-42fa-860d-a8a3dcb1f7af tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:17.604253 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-bb2f56a7-3218-42fa-860d-a8a3dcb1f7af tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:17.604694 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-bb2f56a7-3218-42fa-860d-a8a3dcb1f7af tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:17.605389 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-bb2f56a7-3218-42fa-860d-a8a3dcb1f7af tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:17.605874 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-bb2f56a7-3218-42fa-860d-a8a3dcb1f7af tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:17.606304 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-bb2f56a7-3218-42fa-860d-a8a3dcb1f7af tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:17.968074 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-bb2f56a7-3218-42fa-860d-a8a3dcb1f7af tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbeda8236874f2ca69a6638c626e466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2956107c4664ccd8a7517a707982d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:24:17.975906 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-bb2f56a7-3218-42fa-860d-a8a3dcb1f7af tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] 10.222.0.16 "GET /compute/v2.1/servers/a61dd73b-990e-4832-8528-41baab5db81a" status: 200 len: 1318 microversion: 2.1 time: 0.383875 Oct 31 19:24:17.976484 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 240/484] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:24:17 2022] GET /compute/v2.1/servers/a61dd73b-990e-4832-8528-41baab5db81a => generated 1318 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:24:18.998854 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-ecc92402-c5eb-47a1-a52d-cad586741303 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:24:18.999460 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-ecc92402-c5eb-47a1-a52d-cad586741303 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] [instance: a61dd73b-990e-4832-8528-41baab5db81a] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:24:19.006384 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-ecc92402-c5eb-47a1-a52d-cad586741303 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:19.006859 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-ecc92402-c5eb-47a1-a52d-cad586741303 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:19.007293 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-ecc92402-c5eb-47a1-a52d-cad586741303 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:19.007984 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-ecc92402-c5eb-47a1-a52d-cad586741303 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:19.008441 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-ecc92402-c5eb-47a1-a52d-cad586741303 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:19.008862 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-ecc92402-c5eb-47a1-a52d-cad586741303 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:19.138179 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-ecc92402-c5eb-47a1-a52d-cad586741303 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbeda8236874f2ca69a6638c626e466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2956107c4664ccd8a7517a707982d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:24:19.146448 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-ecc92402-c5eb-47a1-a52d-cad586741303 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] 10.222.0.16 "GET /compute/v2.1/servers/a61dd73b-990e-4832-8528-41baab5db81a" status: 200 len: 1318 microversion: 2.1 time: 0.151452 Oct 31 19:24:19.147023 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 245/485] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:24:18 2022] GET /compute/v2.1/servers/a61dd73b-990e-4832-8528-41baab5db81a => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:24:19.864640 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [req-2c5b7c27-5781-4699-b2d8-f45d604dd841 req-03e0731c-e783-4545-befe-41a1288bcc2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a61dd73b-990e-4832-8528-41baab5db81a", "name": "network-vif-plugged", "status": "completed", "tag": "2b55714e-6a22-4127-82d1-55a0ecf6a90f"}]} {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:24:19.874420 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [req-2c5b7c27-5781-4699-b2d8-f45d604dd841 req-03e0731c-e783-4545-befe-41a1288bcc2c service nova] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:19.874893 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [req-2c5b7c27-5781-4699-b2d8-f45d604dd841 req-03e0731c-e783-4545-befe-41a1288bcc2c service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:19.875316 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [req-2c5b7c27-5781-4699-b2d8-f45d604dd841 req-03e0731c-e783-4545-befe-41a1288bcc2c service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:19.886815 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.compute.server_external_events [req-2c5b7c27-5781-4699-b2d8-f45d604dd841 req-03e0731c-e783-4545-befe-41a1288bcc2c service nova] Creating event network-vif-plugged:2b55714e-6a22-4127-82d1-55a0ecf6a90f for instance a61dd73b-990e-4832-8528-41baab5db81a on hv-cinder-86309 Oct 31 19:24:19.891601 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [req-2c5b7c27-5781-4699-b2d8-f45d604dd841 req-03e0731c-e783-4545-befe-41a1288bcc2c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030754 Oct 31 19:24:19.893069 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 241/486] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 31 19:24:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:24:20.169077 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-8f33c450-e47b-4989-97a5-5ff6156d49f5 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:24:20.170075 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-8f33c450-e47b-4989-97a5-5ff6156d49f5 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] [instance: a61dd73b-990e-4832-8528-41baab5db81a] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:24:20.176679 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-8f33c450-e47b-4989-97a5-5ff6156d49f5 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:20.177188 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-8f33c450-e47b-4989-97a5-5ff6156d49f5 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:20.177633 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-8f33c450-e47b-4989-97a5-5ff6156d49f5 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:20.178315 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-8f33c450-e47b-4989-97a5-5ff6156d49f5 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:20.178762 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-8f33c450-e47b-4989-97a5-5ff6156d49f5 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:20.179178 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-8f33c450-e47b-4989-97a5-5ff6156d49f5 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:20.305250 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-8f33c450-e47b-4989-97a5-5ff6156d49f5 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbeda8236874f2ca69a6638c626e466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2956107c4664ccd8a7517a707982d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:24:20.312787 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-8f33c450-e47b-4989-97a5-5ff6156d49f5 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] 10.222.0.16 "GET /compute/v2.1/servers/a61dd73b-990e-4832-8528-41baab5db81a" status: 200 len: 1318 microversion: 2.1 time: 0.147814 Oct 31 19:24:20.313352 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 246/487] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:24:20 2022] GET /compute/v2.1/servers/a61dd73b-990e-4832-8528-41baab5db81a => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:24:21.336175 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-4f152e2d-41cd-4f91-9895-b53de1a8f0d0 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:24:21.336873 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-4f152e2d-41cd-4f91-9895-b53de1a8f0d0 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] [instance: a61dd73b-990e-4832-8528-41baab5db81a] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:24:21.342966 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-4f152e2d-41cd-4f91-9895-b53de1a8f0d0 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:21.343437 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-4f152e2d-41cd-4f91-9895-b53de1a8f0d0 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:21.343868 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-4f152e2d-41cd-4f91-9895-b53de1a8f0d0 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:21.344543 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-4f152e2d-41cd-4f91-9895-b53de1a8f0d0 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:21.345000 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-4f152e2d-41cd-4f91-9895-b53de1a8f0d0 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:21.345421 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-4f152e2d-41cd-4f91-9895-b53de1a8f0d0 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:21.379785 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-210573b7-71cc-4c6e-b892-0385a1a8f670 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "10dfa9ba-1b6b-498e-b27b-3957452bb604"}} {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:24:21.382278 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-210573b7-71cc-4c6e-b892-0385a1a8f670 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 3097dda0-1cb7-439c-b44a-898c488a6448] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:24:21.388839 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-210573b7-71cc-4c6e-b892-0385a1a8f670 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:21.389407 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-210573b7-71cc-4c6e-b892-0385a1a8f670 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:21.389866 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-210573b7-71cc-4c6e-b892-0385a1a8f670 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:21.390558 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-210573b7-71cc-4c6e-b892-0385a1a8f670 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:21.390995 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-210573b7-71cc-4c6e-b892-0385a1a8f670 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:21.391410 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-210573b7-71cc-4c6e-b892-0385a1a8f670 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:21.475015 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-4f152e2d-41cd-4f91-9895-b53de1a8f0d0 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbeda8236874f2ca69a6638c626e466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2956107c4664ccd8a7517a707982d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:24:21.483133 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-4f152e2d-41cd-4f91-9895-b53de1a8f0d0 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] 10.222.0.16 "GET /compute/v2.1/servers/a61dd73b-990e-4832-8528-41baab5db81a" status: 200 len: 1318 microversion: 2.1 time: 0.151581 Oct 31 19:24:21.483705 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 242/488] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:24:21 2022] GET /compute/v2.1/servers/a61dd73b-990e-4832-8528-41baab5db81a => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:24:21.971376 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG dbcounter [-] [118727] Writing DB stats nova_cell0:SELECT=2 {{(pid=118727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:24:22.184070 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG dbcounter [-] [118727] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=118727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:24:22.194278 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-210573b7-71cc-4c6e-b892-0385a1a8f670 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "POST /compute/v2.1/servers/3097dda0-1cb7-439c-b44a-898c488a6448/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.819019 Oct 31 19:24:22.194872 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 247/489] 10.222.0.16 () {60 vars in 1323 bytes} [Mon Oct 31 19:24:21 2022] POST /compute/v2.1/servers/3097dda0-1cb7-439c-b44a-898c488a6448/os-volume_attachments => generated 194 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 19:24:22.505995 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-3745b913-032c-40f0-9f31-7953c7addf85 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:24:22.506533 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-3745b913-032c-40f0-9f31-7953c7addf85 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] [instance: a61dd73b-990e-4832-8528-41baab5db81a] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:24:22.508421 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG dbcounter [-] [118726] Writing DB stats nova_cell0:SELECT=2 {{(pid=118726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:24:22.509179 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG dbcounter [-] [118726] Writing DB stats nova_cell0:SELECT=6 {{(pid=118726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:24:22.515238 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-3745b913-032c-40f0-9f31-7953c7addf85 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:22.515711 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-3745b913-032c-40f0-9f31-7953c7addf85 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:22.516136 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-3745b913-032c-40f0-9f31-7953c7addf85 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:22.516813 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-3745b913-032c-40f0-9f31-7953c7addf85 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:22.517261 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-3745b913-032c-40f0-9f31-7953c7addf85 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:22.517767 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-3745b913-032c-40f0-9f31-7953c7addf85 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:22.648649 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-3745b913-032c-40f0-9f31-7953c7addf85 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbeda8236874f2ca69a6638c626e466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2956107c4664ccd8a7517a707982d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:24:22.656191 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-3745b913-032c-40f0-9f31-7953c7addf85 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] 10.222.0.16 "GET /compute/v2.1/servers/a61dd73b-990e-4832-8528-41baab5db81a" status: 200 len: 1508 microversion: 2.1 time: 0.154198 Oct 31 19:24:22.656757 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 243/490] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:24:22 2022] GET /compute/v2.1/servers/a61dd73b-990e-4832-8528-41baab5db81a => generated 1508 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:24:29.740213 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-9a041340-0e1d-4074-872f-da5e6eebf501 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:24:29.742609 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-9a041340-0e1d-4074-872f-da5e6eebf501 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 3097dda0-1cb7-439c-b44a-898c488a6448] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:24:29.748758 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-9a041340-0e1d-4074-872f-da5e6eebf501 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:29.749239 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-9a041340-0e1d-4074-872f-da5e6eebf501 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:29.749768 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-9a041340-0e1d-4074-872f-da5e6eebf501 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:29.750457 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-9a041340-0e1d-4074-872f-da5e6eebf501 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:29.750909 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-9a041340-0e1d-4074-872f-da5e6eebf501 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:29.751330 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-9a041340-0e1d-4074-872f-da5e6eebf501 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:29.773870 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.objects.instance [None req-9a041340-0e1d-4074-872f-da5e6eebf501 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lazy-loading 'flavor' on Instance uuid 3097dda0-1cb7-439c-b44a-898c488a6448 {{(pid=118727) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 19:24:29.900911 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-9a041340-0e1d-4074-872f-da5e6eebf501 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "POST /compute/v2.1/servers/3097dda0-1cb7-439c-b44a-898c488a6448/action" status: 200 len: 32 microversion: 2.1 time: 0.165846 Oct 31 19:24:29.901429 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 248/491] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 31 19:24:29 2022] POST /compute/v2.1/servers/3097dda0-1cb7-439c-b44a-898c488a6448/action => generated 32 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 19:24:29.910987 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-bb9ee4d7-cba1-4d0b-a7a1-661b53bbe0b9 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:24:29.911779 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-bb9ee4d7-cba1-4d0b-a7a1-661b53bbe0b9 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 3097dda0-1cb7-439c-b44a-898c488a6448] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:24:29.919139 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-bb9ee4d7-cba1-4d0b-a7a1-661b53bbe0b9 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:29.919779 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-bb9ee4d7-cba1-4d0b-a7a1-661b53bbe0b9 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:29.920398 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-bb9ee4d7-cba1-4d0b-a7a1-661b53bbe0b9 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:29.921237 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-bb9ee4d7-cba1-4d0b-a7a1-661b53bbe0b9 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:29.922119 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-bb9ee4d7-cba1-4d0b-a7a1-661b53bbe0b9 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:29.922865 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-bb9ee4d7-cba1-4d0b-a7a1-661b53bbe0b9 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:30.057891 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-bb9ee4d7-cba1-4d0b-a7a1-661b53bbe0b9 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc49f9eb3114759b2889ed8972136d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cf63c76fc543428404002ae9a75b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:24:30.068282 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-bb9ee4d7-cba1-4d0b-a7a1-661b53bbe0b9 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/3097dda0-1cb7-439c-b44a-898c488a6448" status: 200 len: 1733 microversion: 2.1 time: 0.161041 Oct 31 19:24:30.069174 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 244/492] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:24:29 2022] GET /compute/v2.1/servers/3097dda0-1cb7-439c-b44a-898c488a6448 => generated 1733 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:24:31.092700 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-cb0b045a-3fb0-43f4-a15a-b38d97854c71 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:24:31.093450 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-cb0b045a-3fb0-43f4-a15a-b38d97854c71 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 3097dda0-1cb7-439c-b44a-898c488a6448] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:24:31.100499 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-cb0b045a-3fb0-43f4-a15a-b38d97854c71 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:31.101001 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-cb0b045a-3fb0-43f4-a15a-b38d97854c71 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:31.101475 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-cb0b045a-3fb0-43f4-a15a-b38d97854c71 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:31.102260 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-cb0b045a-3fb0-43f4-a15a-b38d97854c71 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:31.102716 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-cb0b045a-3fb0-43f4-a15a-b38d97854c71 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:31.103140 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-cb0b045a-3fb0-43f4-a15a-b38d97854c71 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:31.237264 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-cb0b045a-3fb0-43f4-a15a-b38d97854c71 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc49f9eb3114759b2889ed8972136d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cf63c76fc543428404002ae9a75b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:24:31.245374 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-cb0b045a-3fb0-43f4-a15a-b38d97854c71 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/3097dda0-1cb7-439c-b44a-898c488a6448" status: 200 len: 1733 microversion: 2.1 time: 0.157705 Oct 31 19:24:31.245975 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 249/493] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:24:31 2022] GET /compute/v2.1/servers/3097dda0-1cb7-439c-b44a-898c488a6448 => generated 1733 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:24:32.268180 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-bdc38e28-dfc9-41aa-bd33-90a607211fc5 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:24:32.268788 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-bdc38e28-dfc9-41aa-bd33-90a607211fc5 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 3097dda0-1cb7-439c-b44a-898c488a6448] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:24:32.275181 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-bdc38e28-dfc9-41aa-bd33-90a607211fc5 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:32.275663 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-bdc38e28-dfc9-41aa-bd33-90a607211fc5 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:32.276096 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-bdc38e28-dfc9-41aa-bd33-90a607211fc5 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:32.276782 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-bdc38e28-dfc9-41aa-bd33-90a607211fc5 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:32.277237 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-bdc38e28-dfc9-41aa-bd33-90a607211fc5 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:32.277686 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-bdc38e28-dfc9-41aa-bd33-90a607211fc5 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:32.416658 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-bdc38e28-dfc9-41aa-bd33-90a607211fc5 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc49f9eb3114759b2889ed8972136d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cf63c76fc543428404002ae9a75b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:24:32.426509 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-bdc38e28-dfc9-41aa-bd33-90a607211fc5 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/3097dda0-1cb7-439c-b44a-898c488a6448" status: 200 len: 1733 microversion: 2.1 time: 0.161886 Oct 31 19:24:32.427372 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 245/494] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:24:32 2022] GET /compute/v2.1/servers/3097dda0-1cb7-439c-b44a-898c488a6448 => generated 1733 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:24:33.450704 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-bf6014b4-cc09-4a14-b502-e72573d082de tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:24:33.451308 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-bf6014b4-cc09-4a14-b502-e72573d082de tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 3097dda0-1cb7-439c-b44a-898c488a6448] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:24:33.458328 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-bf6014b4-cc09-4a14-b502-e72573d082de tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:33.458803 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-bf6014b4-cc09-4a14-b502-e72573d082de tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:33.459231 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-bf6014b4-cc09-4a14-b502-e72573d082de tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:33.459903 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-bf6014b4-cc09-4a14-b502-e72573d082de tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:33.460353 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-bf6014b4-cc09-4a14-b502-e72573d082de tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:33.460772 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-bf6014b4-cc09-4a14-b502-e72573d082de tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:33.592473 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-bf6014b4-cc09-4a14-b502-e72573d082de tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc49f9eb3114759b2889ed8972136d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cf63c76fc543428404002ae9a75b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:24:33.601461 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-bf6014b4-cc09-4a14-b502-e72573d082de tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/3097dda0-1cb7-439c-b44a-898c488a6448" status: 200 len: 1733 microversion: 2.1 time: 0.154701 Oct 31 19:24:33.602070 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 250/495] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:24:33 2022] GET /compute/v2.1/servers/3097dda0-1cb7-439c-b44a-898c488a6448 => generated 1733 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:24:34.624268 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-de277371-12a2-40f5-b1dc-d7d429d47b2b tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:24:34.624852 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-de277371-12a2-40f5-b1dc-d7d429d47b2b tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 3097dda0-1cb7-439c-b44a-898c488a6448] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:24:34.631831 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-de277371-12a2-40f5-b1dc-d7d429d47b2b tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:34.632309 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-de277371-12a2-40f5-b1dc-d7d429d47b2b tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:34.632739 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-de277371-12a2-40f5-b1dc-d7d429d47b2b tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:34.633423 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-de277371-12a2-40f5-b1dc-d7d429d47b2b tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:34.633890 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-de277371-12a2-40f5-b1dc-d7d429d47b2b tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:34.634307 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-de277371-12a2-40f5-b1dc-d7d429d47b2b tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:34.636963 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG dbcounter [-] [118726] Writing DB stats nova_cell1:SELECT=99 {{(pid=118726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:24:34.764927 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-de277371-12a2-40f5-b1dc-d7d429d47b2b tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc49f9eb3114759b2889ed8972136d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cf63c76fc543428404002ae9a75b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:24:34.773018 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-de277371-12a2-40f5-b1dc-d7d429d47b2b tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/3097dda0-1cb7-439c-b44a-898c488a6448" status: 200 len: 1733 microversion: 2.1 time: 0.152654 Oct 31 19:24:34.773581 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 246/496] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:24:34 2022] GET /compute/v2.1/servers/3097dda0-1cb7-439c-b44a-898c488a6448 => generated 1733 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:24:35.541898 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-7e217794-9fce-4a50-88f8-b3cea2b8a599 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:24:35.542466 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-7e217794-9fce-4a50-88f8-b3cea2b8a599 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] [instance: 0a122a08-bc0f-40fd-8139-74c9e8a70ebe] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:24:35.544731 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG dbcounter [-] [118727] Writing DB stats nova_api:SELECT=40 {{(pid=118727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:24:35.549974 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-7e217794-9fce-4a50-88f8-b3cea2b8a599 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:35.550454 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-7e217794-9fce-4a50-88f8-b3cea2b8a599 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:35.550883 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-7e217794-9fce-4a50-88f8-b3cea2b8a599 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:35.551705 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-7e217794-9fce-4a50-88f8-b3cea2b8a599 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:35.552151 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-7e217794-9fce-4a50-88f8-b3cea2b8a599 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:35.552563 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-7e217794-9fce-4a50-88f8-b3cea2b8a599 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:35.678163 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.objects.instance [None req-7e217794-9fce-4a50-88f8-b3cea2b8a599 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lazy-loading 'services' on Instance uuid 0a122a08-bc0f-40fd-8139-74c9e8a70ebe {{(pid=118727) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 19:24:35.794918 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-7e217794-9fce-4a50-88f8-b3cea2b8a599 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] 10.222.0.16 "DELETE /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe/os-volume_attachments/da95725e-e3cf-40c8-8bce-8fe11a45eb4e" status: 202 len: 0 microversion: 2.1 time: 0.257011 Oct 31 19:24:35.795733 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 251/497] 10.222.0.16 () {58 vars in 1416 bytes} [Mon Oct 31 19:24:35 2022] DELETE /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe/os-volume_attachments/da95725e-e3cf-40c8-8bce-8fe11a45eb4e => generated 0 bytes in 259 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 19:24:35.796471 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-3d1efe89-fa7b-46b3-82d6-8aa9fa7d3c02 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:24:35.797074 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-3d1efe89-fa7b-46b3-82d6-8aa9fa7d3c02 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 3097dda0-1cb7-439c-b44a-898c488a6448] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:24:35.805347 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-3d1efe89-fa7b-46b3-82d6-8aa9fa7d3c02 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:35.805861 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-3d1efe89-fa7b-46b3-82d6-8aa9fa7d3c02 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:35.806300 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-3d1efe89-fa7b-46b3-82d6-8aa9fa7d3c02 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:35.807051 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-3d1efe89-fa7b-46b3-82d6-8aa9fa7d3c02 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:35.807491 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-3d1efe89-fa7b-46b3-82d6-8aa9fa7d3c02 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:35.807939 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-3d1efe89-fa7b-46b3-82d6-8aa9fa7d3c02 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:35.939782 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-3d1efe89-fa7b-46b3-82d6-8aa9fa7d3c02 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc49f9eb3114759b2889ed8972136d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cf63c76fc543428404002ae9a75b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:24:35.948806 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-3d1efe89-fa7b-46b3-82d6-8aa9fa7d3c02 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/3097dda0-1cb7-439c-b44a-898c488a6448" status: 200 len: 1733 microversion: 2.1 time: 0.156239 Oct 31 19:24:35.949379 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 247/498] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:24:35 2022] GET /compute/v2.1/servers/3097dda0-1cb7-439c-b44a-898c488a6448 => generated 1733 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:24:36.931757 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-dcf808bb-ec6e-4561-97ec-6a88cb4dbb2d tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:24:36.938144 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-dcf808bb-ec6e-4561-97ec-6a88cb4dbb2d tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:36.938631 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-dcf808bb-ec6e-4561-97ec-6a88cb4dbb2d tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:36.939064 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-dcf808bb-ec6e-4561-97ec-6a88cb4dbb2d tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:36.961438 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-dcf808bb-ec6e-4561-97ec-6a88cb4dbb2d tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] [instance: 0a122a08-bc0f-40fd-8139-74c9e8a70ebe] Going to try to stop instance {{(pid=118727) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 31 19:24:36.971785 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-a6e24828-0481-44b6-9825-bf4800dfe467 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:24:36.972401 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-a6e24828-0481-44b6-9825-bf4800dfe467 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 3097dda0-1cb7-439c-b44a-898c488a6448] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:24:36.979322 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-a6e24828-0481-44b6-9825-bf4800dfe467 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:36.979810 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-a6e24828-0481-44b6-9825-bf4800dfe467 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:36.980246 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-a6e24828-0481-44b6-9825-bf4800dfe467 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:36.980942 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-a6e24828-0481-44b6-9825-bf4800dfe467 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:36.981408 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-a6e24828-0481-44b6-9825-bf4800dfe467 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:36.981864 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-a6e24828-0481-44b6-9825-bf4800dfe467 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:37.002747 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-dcf808bb-ec6e-4561-97ec-6a88cb4dbb2d tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] 10.222.0.16 "POST /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe/action" status: 202 len: 0 microversion: 2.1 time: 0.076335 Oct 31 19:24:37.006420 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 252/499] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 31 19:24:36 2022] POST /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 19:24:37.012968 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-ed171c26-2f30-446b-b538-c08552ca6a1f tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:24:37.013730 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-ed171c26-2f30-446b-b538-c08552ca6a1f tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] [instance: 0a122a08-bc0f-40fd-8139-74c9e8a70ebe] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:24:37.020352 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-ed171c26-2f30-446b-b538-c08552ca6a1f tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:37.020838 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-ed171c26-2f30-446b-b538-c08552ca6a1f tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:37.021417 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-ed171c26-2f30-446b-b538-c08552ca6a1f tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:37.022321 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-ed171c26-2f30-446b-b538-c08552ca6a1f tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:37.022898 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-ed171c26-2f30-446b-b538-c08552ca6a1f tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:37.023451 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-ed171c26-2f30-446b-b538-c08552ca6a1f tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:37.122356 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-a6e24828-0481-44b6-9825-bf4800dfe467 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc49f9eb3114759b2889ed8972136d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cf63c76fc543428404002ae9a75b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:24:37.131122 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-a6e24828-0481-44b6-9825-bf4800dfe467 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/3097dda0-1cb7-439c-b44a-898c488a6448" status: 200 len: 1733 microversion: 2.1 time: 0.163136 Oct 31 19:24:37.131712 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 248/500] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:24:36 2022] GET /compute/v2.1/servers/3097dda0-1cb7-439c-b44a-898c488a6448 => generated 1733 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 19:24:37.164104 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-ed171c26-2f30-446b-b538-c08552ca6a1f tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ece6ca9374764214bac6263bd691bc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9c317b548b40deb8cb27236d36d674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:24:37.171943 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-ed171c26-2f30-446b-b538-c08552ca6a1f tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] 10.222.0.16 "GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe" status: 200 len: 1675 microversion: 2.1 time: 0.164122 Oct 31 19:24:37.172510 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 253/501] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:24:37 2022] GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe => generated 1675 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:24:38.153855 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-6d504d24-d26a-4d92-923e-0fe3903b53f1 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:24:38.154461 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-6d504d24-d26a-4d92-923e-0fe3903b53f1 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 3097dda0-1cb7-439c-b44a-898c488a6448] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:24:38.161303 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-6d504d24-d26a-4d92-923e-0fe3903b53f1 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:38.161814 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-6d504d24-d26a-4d92-923e-0fe3903b53f1 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:38.162254 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-6d504d24-d26a-4d92-923e-0fe3903b53f1 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:38.162938 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-6d504d24-d26a-4d92-923e-0fe3903b53f1 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:38.163390 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-6d504d24-d26a-4d92-923e-0fe3903b53f1 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:38.163814 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-6d504d24-d26a-4d92-923e-0fe3903b53f1 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:38.195016 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-60ed5adb-4f49-4909-9fbd-3a2fe086571e tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:24:38.195728 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-60ed5adb-4f49-4909-9fbd-3a2fe086571e tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] [instance: 0a122a08-bc0f-40fd-8139-74c9e8a70ebe] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:24:38.202152 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-60ed5adb-4f49-4909-9fbd-3a2fe086571e tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:38.202702 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-60ed5adb-4f49-4909-9fbd-3a2fe086571e tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:38.203200 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-60ed5adb-4f49-4909-9fbd-3a2fe086571e tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:38.203946 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-60ed5adb-4f49-4909-9fbd-3a2fe086571e tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:38.204404 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-60ed5adb-4f49-4909-9fbd-3a2fe086571e tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:38.204820 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-60ed5adb-4f49-4909-9fbd-3a2fe086571e tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:38.293162 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-6d504d24-d26a-4d92-923e-0fe3903b53f1 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc49f9eb3114759b2889ed8972136d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cf63c76fc543428404002ae9a75b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:24:38.301907 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-6d504d24-d26a-4d92-923e-0fe3903b53f1 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/3097dda0-1cb7-439c-b44a-898c488a6448" status: 200 len: 1733 microversion: 2.1 time: 0.151366 Oct 31 19:24:38.302479 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 249/502] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:24:38 2022] GET /compute/v2.1/servers/3097dda0-1cb7-439c-b44a-898c488a6448 => generated 1733 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:24:38.341841 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-60ed5adb-4f49-4909-9fbd-3a2fe086571e tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ece6ca9374764214bac6263bd691bc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9c317b548b40deb8cb27236d36d674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:24:38.349958 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-60ed5adb-4f49-4909-9fbd-3a2fe086571e tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] 10.222.0.16 "GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe" status: 200 len: 1675 microversion: 2.1 time: 0.158709 Oct 31 19:24:38.350519 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 254/503] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:24:38 2022] GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe => generated 1675 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 19:24:39.325066 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-688614ed-2323-4c58-9428-6328f6a1b695 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:24:39.325693 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-688614ed-2323-4c58-9428-6328f6a1b695 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 3097dda0-1cb7-439c-b44a-898c488a6448] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:24:39.332079 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-688614ed-2323-4c58-9428-6328f6a1b695 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:39.332560 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-688614ed-2323-4c58-9428-6328f6a1b695 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:39.332994 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-688614ed-2323-4c58-9428-6328f6a1b695 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:39.333721 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-688614ed-2323-4c58-9428-6328f6a1b695 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:39.334175 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-688614ed-2323-4c58-9428-6328f6a1b695 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:39.334597 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-688614ed-2323-4c58-9428-6328f6a1b695 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:39.373390 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-b77a5320-baa8-443c-8fb1-3edfcaf9f077 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:24:39.374029 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-b77a5320-baa8-443c-8fb1-3edfcaf9f077 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] [instance: 0a122a08-bc0f-40fd-8139-74c9e8a70ebe] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:24:39.380992 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-b77a5320-baa8-443c-8fb1-3edfcaf9f077 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:39.381474 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-b77a5320-baa8-443c-8fb1-3edfcaf9f077 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:39.381937 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-b77a5320-baa8-443c-8fb1-3edfcaf9f077 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:39.382630 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-b77a5320-baa8-443c-8fb1-3edfcaf9f077 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:39.383085 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-b77a5320-baa8-443c-8fb1-3edfcaf9f077 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:39.383507 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-b77a5320-baa8-443c-8fb1-3edfcaf9f077 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:39.465724 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-688614ed-2323-4c58-9428-6328f6a1b695 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc49f9eb3114759b2889ed8972136d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cf63c76fc543428404002ae9a75b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:24:39.474093 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-688614ed-2323-4c58-9428-6328f6a1b695 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/3097dda0-1cb7-439c-b44a-898c488a6448" status: 200 len: 1733 microversion: 2.1 time: 0.152769 Oct 31 19:24:39.474764 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 250/504] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:24:39 2022] GET /compute/v2.1/servers/3097dda0-1cb7-439c-b44a-898c488a6448 => generated 1733 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:24:39.512778 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-b77a5320-baa8-443c-8fb1-3edfcaf9f077 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ece6ca9374764214bac6263bd691bc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9c317b548b40deb8cb27236d36d674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:24:39.520353 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-b77a5320-baa8-443c-8fb1-3edfcaf9f077 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] 10.222.0.16 "GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe" status: 200 len: 1675 microversion: 2.1 time: 0.150841 Oct 31 19:24:39.520946 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 255/505] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:24:39 2022] GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe => generated 1675 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 19:24:40.500163 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-87546945-b24e-45a5-8fb8-0b3c143c593a tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:24:40.500764 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-87546945-b24e-45a5-8fb8-0b3c143c593a tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 3097dda0-1cb7-439c-b44a-898c488a6448] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:24:40.507688 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-87546945-b24e-45a5-8fb8-0b3c143c593a tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:40.508139 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-87546945-b24e-45a5-8fb8-0b3c143c593a tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:40.508510 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-87546945-b24e-45a5-8fb8-0b3c143c593a tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:40.509178 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-87546945-b24e-45a5-8fb8-0b3c143c593a tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:40.509649 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-87546945-b24e-45a5-8fb8-0b3c143c593a tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:40.510071 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-87546945-b24e-45a5-8fb8-0b3c143c593a tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:40.543112 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-03a83c78-d0b3-4c76-a8a2-03c79df664cb tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:24:40.543718 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-03a83c78-d0b3-4c76-a8a2-03c79df664cb tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] [instance: 0a122a08-bc0f-40fd-8139-74c9e8a70ebe] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:24:40.550108 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-03a83c78-d0b3-4c76-a8a2-03c79df664cb tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:40.550588 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-03a83c78-d0b3-4c76-a8a2-03c79df664cb tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:40.551020 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-03a83c78-d0b3-4c76-a8a2-03c79df664cb tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:40.551746 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-03a83c78-d0b3-4c76-a8a2-03c79df664cb tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:40.552201 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-03a83c78-d0b3-4c76-a8a2-03c79df664cb tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:40.552619 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-03a83c78-d0b3-4c76-a8a2-03c79df664cb tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:40.637407 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-87546945-b24e-45a5-8fb8-0b3c143c593a tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc49f9eb3114759b2889ed8972136d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cf63c76fc543428404002ae9a75b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:24:40.646159 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-87546945-b24e-45a5-8fb8-0b3c143c593a tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/3097dda0-1cb7-439c-b44a-898c488a6448" status: 200 len: 1733 microversion: 2.1 time: 0.149883 Oct 31 19:24:40.646982 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 251/506] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:24:40 2022] GET /compute/v2.1/servers/3097dda0-1cb7-439c-b44a-898c488a6448 => generated 1733 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:24:40.684347 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-03a83c78-d0b3-4c76-a8a2-03c79df664cb tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ece6ca9374764214bac6263bd691bc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9c317b548b40deb8cb27236d36d674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:24:40.692513 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-03a83c78-d0b3-4c76-a8a2-03c79df664cb tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] 10.222.0.16 "GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe" status: 200 len: 1675 microversion: 2.1 time: 0.153393 Oct 31 19:24:40.693083 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 256/507] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:24:40 2022] GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe => generated 1675 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 19:24:41.669839 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-fb98d9d8-6f98-47f2-9642-695844517653 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:24:41.670439 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-fb98d9d8-6f98-47f2-9642-695844517653 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 3097dda0-1cb7-439c-b44a-898c488a6448] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:24:41.672696 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG dbcounter [-] [118726] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3 {{(pid=118726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:24:41.677853 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-fb98d9d8-6f98-47f2-9642-695844517653 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:41.678326 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-fb98d9d8-6f98-47f2-9642-695844517653 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:41.678750 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-fb98d9d8-6f98-47f2-9642-695844517653 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:41.679427 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-fb98d9d8-6f98-47f2-9642-695844517653 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:41.679878 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-fb98d9d8-6f98-47f2-9642-695844517653 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:41.680292 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-fb98d9d8-6f98-47f2-9642-695844517653 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:41.716157 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-f4482b42-5fe7-4afb-9617-0b4b88a8e238 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:24:41.716796 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-f4482b42-5fe7-4afb-9617-0b4b88a8e238 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] [instance: 0a122a08-bc0f-40fd-8139-74c9e8a70ebe] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:24:41.725245 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-f4482b42-5fe7-4afb-9617-0b4b88a8e238 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:41.725763 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-f4482b42-5fe7-4afb-9617-0b4b88a8e238 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:41.726199 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-f4482b42-5fe7-4afb-9617-0b4b88a8e238 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:41.726909 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-f4482b42-5fe7-4afb-9617-0b4b88a8e238 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:41.727355 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-f4482b42-5fe7-4afb-9617-0b4b88a8e238 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:41.727780 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-f4482b42-5fe7-4afb-9617-0b4b88a8e238 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:41.812469 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-fb98d9d8-6f98-47f2-9642-695844517653 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc49f9eb3114759b2889ed8972136d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cf63c76fc543428404002ae9a75b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:24:41.821181 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-fb98d9d8-6f98-47f2-9642-695844517653 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/3097dda0-1cb7-439c-b44a-898c488a6448" status: 200 len: 1733 microversion: 2.1 time: 0.155432 Oct 31 19:24:41.821949 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 252/508] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:24:41 2022] GET /compute/v2.1/servers/3097dda0-1cb7-439c-b44a-898c488a6448 => generated 1733 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:24:41.857387 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-f4482b42-5fe7-4afb-9617-0b4b88a8e238 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ece6ca9374764214bac6263bd691bc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9c317b548b40deb8cb27236d36d674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:24:41.865060 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-f4482b42-5fe7-4afb-9617-0b4b88a8e238 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] 10.222.0.16 "GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe" status: 200 len: 1675 microversion: 2.1 time: 0.152759 Oct 31 19:24:41.865648 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 257/509] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:24:41 2022] GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe => generated 1675 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 19:24:42.844618 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-29fd56ef-d7fc-4b90-85b4-edb00de4207a tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:24:42.845227 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-29fd56ef-d7fc-4b90-85b4-edb00de4207a tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 3097dda0-1cb7-439c-b44a-898c488a6448] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:24:42.852000 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-29fd56ef-d7fc-4b90-85b4-edb00de4207a tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:42.852483 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-29fd56ef-d7fc-4b90-85b4-edb00de4207a tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:42.852914 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-29fd56ef-d7fc-4b90-85b4-edb00de4207a tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:42.853625 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-29fd56ef-d7fc-4b90-85b4-edb00de4207a tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:42.854081 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-29fd56ef-d7fc-4b90-85b4-edb00de4207a tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:42.854506 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-29fd56ef-d7fc-4b90-85b4-edb00de4207a tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:42.888065 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-68c52b53-0edd-4060-a5a1-8feea76a5fab tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:24:42.888703 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-68c52b53-0edd-4060-a5a1-8feea76a5fab tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] [instance: 0a122a08-bc0f-40fd-8139-74c9e8a70ebe] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:24:42.895090 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-68c52b53-0edd-4060-a5a1-8feea76a5fab tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:42.895574 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-68c52b53-0edd-4060-a5a1-8feea76a5fab tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:42.896008 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-68c52b53-0edd-4060-a5a1-8feea76a5fab tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:42.896698 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-68c52b53-0edd-4060-a5a1-8feea76a5fab tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:42.897148 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-68c52b53-0edd-4060-a5a1-8feea76a5fab tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:42.897572 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-68c52b53-0edd-4060-a5a1-8feea76a5fab tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:42.981750 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-29fd56ef-d7fc-4b90-85b4-edb00de4207a tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc49f9eb3114759b2889ed8972136d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cf63c76fc543428404002ae9a75b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:24:42.989904 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-29fd56ef-d7fc-4b90-85b4-edb00de4207a tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/3097dda0-1cb7-439c-b44a-898c488a6448" status: 200 len: 1733 microversion: 2.1 time: 0.149132 Oct 31 19:24:42.990478 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 253/510] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:24:42 2022] GET /compute/v2.1/servers/3097dda0-1cb7-439c-b44a-898c488a6448 => generated 1733 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:24:43.028006 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-68c52b53-0edd-4060-a5a1-8feea76a5fab tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ece6ca9374764214bac6263bd691bc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9c317b548b40deb8cb27236d36d674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:24:43.035630 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-68c52b53-0edd-4060-a5a1-8feea76a5fab tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] 10.222.0.16 "GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe" status: 200 len: 1675 microversion: 2.1 time: 0.151366 Oct 31 19:24:43.036859 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 258/511] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:24:42 2022] GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe => generated 1675 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 19:24:43.109960 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-c7a509c6-a0b7-4f2a-82c5-1922aca52771 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "adce386f-8e33-4cb0-b70e-11ab18c8d4e0", "device": "/dev/sdb"}} {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:24:43.112815 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-c7a509c6-a0b7-4f2a-82c5-1922aca52771 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] [instance: a61dd73b-990e-4832-8528-41baab5db81a] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:24:43.118554 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-c7a509c6-a0b7-4f2a-82c5-1922aca52771 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:43.119029 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-c7a509c6-a0b7-4f2a-82c5-1922aca52771 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:43.119455 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-c7a509c6-a0b7-4f2a-82c5-1922aca52771 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:43.120123 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-c7a509c6-a0b7-4f2a-82c5-1922aca52771 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:43.120567 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-c7a509c6-a0b7-4f2a-82c5-1922aca52771 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:43.121013 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-c7a509c6-a0b7-4f2a-82c5-1922aca52771 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:43.352785 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-c7a509c6-a0b7-4f2a-82c5-1922aca52771 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] 10.222.0.16 "POST /compute/v2.1/servers/a61dd73b-990e-4832-8528-41baab5db81a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.246527 Oct 31 19:24:43.353381 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 254/512] 10.222.0.16 () {60 vars in 1323 bytes} [Mon Oct 31 19:24:43 2022] POST /compute/v2.1/servers/a61dd73b-990e-4832-8528-41baab5db81a/os-volume_attachments => generated 194 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:24:44.012165 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-e7b5b633-7a3c-4a33-b68f-9e6f6564f20e tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:24:44.012769 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-e7b5b633-7a3c-4a33-b68f-9e6f6564f20e tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 3097dda0-1cb7-439c-b44a-898c488a6448] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:24:44.019248 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-e7b5b633-7a3c-4a33-b68f-9e6f6564f20e tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:44.019731 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-e7b5b633-7a3c-4a33-b68f-9e6f6564f20e tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:44.020161 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-e7b5b633-7a3c-4a33-b68f-9e6f6564f20e tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:44.020837 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-e7b5b633-7a3c-4a33-b68f-9e6f6564f20e tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:44.021294 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-e7b5b633-7a3c-4a33-b68f-9e6f6564f20e tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:44.021746 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-e7b5b633-7a3c-4a33-b68f-9e6f6564f20e tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:44.060222 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-e01ca60d-cb49-44dc-84b9-11070ab44bc5 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:24:44.061041 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-e01ca60d-cb49-44dc-84b9-11070ab44bc5 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] [instance: 0a122a08-bc0f-40fd-8139-74c9e8a70ebe] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:24:44.068057 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-e01ca60d-cb49-44dc-84b9-11070ab44bc5 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:44.068542 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-e01ca60d-cb49-44dc-84b9-11070ab44bc5 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:44.068973 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-e01ca60d-cb49-44dc-84b9-11070ab44bc5 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:44.069995 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-e01ca60d-cb49-44dc-84b9-11070ab44bc5 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:44.070453 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-e01ca60d-cb49-44dc-84b9-11070ab44bc5 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:44.070880 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-e01ca60d-cb49-44dc-84b9-11070ab44bc5 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:44.156104 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-e7b5b633-7a3c-4a33-b68f-9e6f6564f20e tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc49f9eb3114759b2889ed8972136d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cf63c76fc543428404002ae9a75b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:24:44.164927 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-e7b5b633-7a3c-4a33-b68f-9e6f6564f20e tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/3097dda0-1cb7-439c-b44a-898c488a6448" status: 200 len: 1733 microversion: 2.1 time: 0.156588 Oct 31 19:24:44.165500 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 259/513] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:24:44 2022] GET /compute/v2.1/servers/3097dda0-1cb7-439c-b44a-898c488a6448 => generated 1733 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:24:44.200035 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-e01ca60d-cb49-44dc-84b9-11070ab44bc5 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ece6ca9374764214bac6263bd691bc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9c317b548b40deb8cb27236d36d674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:24:44.207617 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-e01ca60d-cb49-44dc-84b9-11070ab44bc5 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] 10.222.0.16 "GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe" status: 200 len: 1675 microversion: 2.1 time: 0.151999 Oct 31 19:24:44.208223 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 255/514] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:24:44 2022] GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe => generated 1675 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 19:24:45.188837 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-e4a9a03f-aaca-4209-bfb8-097b405d9469 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:24:45.189448 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-e4a9a03f-aaca-4209-bfb8-097b405d9469 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 3097dda0-1cb7-439c-b44a-898c488a6448] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:24:45.196419 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-e4a9a03f-aaca-4209-bfb8-097b405d9469 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:45.196898 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-e4a9a03f-aaca-4209-bfb8-097b405d9469 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:45.197333 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-e4a9a03f-aaca-4209-bfb8-097b405d9469 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:45.198046 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-e4a9a03f-aaca-4209-bfb8-097b405d9469 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:45.198500 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-e4a9a03f-aaca-4209-bfb8-097b405d9469 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:45.198921 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-e4a9a03f-aaca-4209-bfb8-097b405d9469 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:45.230414 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-d67563d9-4bb1-4ca4-9054-a4a872155ae1 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:24:45.231025 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-d67563d9-4bb1-4ca4-9054-a4a872155ae1 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] [instance: 0a122a08-bc0f-40fd-8139-74c9e8a70ebe] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:24:45.237595 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-d67563d9-4bb1-4ca4-9054-a4a872155ae1 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:45.238105 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-d67563d9-4bb1-4ca4-9054-a4a872155ae1 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:45.238541 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-d67563d9-4bb1-4ca4-9054-a4a872155ae1 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:45.239739 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-d67563d9-4bb1-4ca4-9054-a4a872155ae1 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:45.240198 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-d67563d9-4bb1-4ca4-9054-a4a872155ae1 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:45.240623 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-d67563d9-4bb1-4ca4-9054-a4a872155ae1 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:45.337957 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-e4a9a03f-aaca-4209-bfb8-097b405d9469 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc49f9eb3114759b2889ed8972136d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cf63c76fc543428404002ae9a75b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:24:45.340249 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG dbcounter [-] [118727] Writing DB stats nova_cell1:INSERT=4,nova_cell1:SELECT=93,nova_cell1:UPDATE=3 {{(pid=118727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:24:45.347309 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-e4a9a03f-aaca-4209-bfb8-097b405d9469 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/3097dda0-1cb7-439c-b44a-898c488a6448" status: 200 len: 1733 microversion: 2.1 time: 0.162209 Oct 31 19:24:45.347893 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 260/515] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:24:45 2022] GET /compute/v2.1/servers/3097dda0-1cb7-439c-b44a-898c488a6448 => generated 1733 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:24:45.384055 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-d67563d9-4bb1-4ca4-9054-a4a872155ae1 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ece6ca9374764214bac6263bd691bc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9c317b548b40deb8cb27236d36d674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:24:45.392141 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-d67563d9-4bb1-4ca4-9054-a4a872155ae1 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] 10.222.0.16 "GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe" status: 200 len: 1675 microversion: 2.1 time: 0.165446 Oct 31 19:24:45.392711 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 256/516] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:24:45 2022] GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe => generated 1675 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 19:24:46.370320 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-ab950287-216d-4c31-a241-57766a54add9 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:24:46.370923 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-ab950287-216d-4c31-a241-57766a54add9 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 3097dda0-1cb7-439c-b44a-898c488a6448] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:24:46.378631 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-ab950287-216d-4c31-a241-57766a54add9 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:46.379108 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-ab950287-216d-4c31-a241-57766a54add9 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:46.380032 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-ab950287-216d-4c31-a241-57766a54add9 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:46.380709 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-ab950287-216d-4c31-a241-57766a54add9 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:46.381156 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-ab950287-216d-4c31-a241-57766a54add9 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:46.381571 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-ab950287-216d-4c31-a241-57766a54add9 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:46.415285 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-9690b04b-3b03-4bc5-baf0-8ec5a558f0ea tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:24:46.415899 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-9690b04b-3b03-4bc5-baf0-8ec5a558f0ea tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] [instance: 0a122a08-bc0f-40fd-8139-74c9e8a70ebe] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:24:46.422638 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-9690b04b-3b03-4bc5-baf0-8ec5a558f0ea tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:46.423127 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-9690b04b-3b03-4bc5-baf0-8ec5a558f0ea tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:46.423563 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-9690b04b-3b03-4bc5-baf0-8ec5a558f0ea tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:46.424254 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-9690b04b-3b03-4bc5-baf0-8ec5a558f0ea tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:46.424712 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-9690b04b-3b03-4bc5-baf0-8ec5a558f0ea tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:46.425136 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-9690b04b-3b03-4bc5-baf0-8ec5a558f0ea tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:46.531418 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-ab950287-216d-4c31-a241-57766a54add9 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc49f9eb3114759b2889ed8972136d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cf63c76fc543428404002ae9a75b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:24:46.539648 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-ab950287-216d-4c31-a241-57766a54add9 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/3097dda0-1cb7-439c-b44a-898c488a6448" status: 200 len: 1733 microversion: 2.1 time: 0.173138 Oct 31 19:24:46.540227 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 261/517] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:24:46 2022] GET /compute/v2.1/servers/3097dda0-1cb7-439c-b44a-898c488a6448 => generated 1733 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:24:46.555173 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-9690b04b-3b03-4bc5-baf0-8ec5a558f0ea tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ece6ca9374764214bac6263bd691bc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9c317b548b40deb8cb27236d36d674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:24:46.557490 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-93c156c0-2f06-44b6-9237-18e714448c11 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:24:46.559825 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-93c156c0-2f06-44b6-9237-18e714448c11 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] [instance: ecd39339-b802-43f3-aba3-432fd6e5387e] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:24:46.563331 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-9690b04b-3b03-4bc5-baf0-8ec5a558f0ea tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] 10.222.0.16 "GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe" status: 200 len: 1675 microversion: 2.1 time: 0.151777 Oct 31 19:24:46.563914 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 257/518] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:24:46 2022] GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe => generated 1675 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 19:24:46.565864 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-93c156c0-2f06-44b6-9237-18e714448c11 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:46.566345 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-93c156c0-2f06-44b6-9237-18e714448c11 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:46.566776 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-93c156c0-2f06-44b6-9237-18e714448c11 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:46.567996 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-93c156c0-2f06-44b6-9237-18e714448c11 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:46.568447 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-93c156c0-2f06-44b6-9237-18e714448c11 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:46.568865 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-93c156c0-2f06-44b6-9237-18e714448c11 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:46.639784 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-93c156c0-2f06-44b6-9237-18e714448c11 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] 10.222.0.16 "POST /compute/v2.1/servers/ecd39339-b802-43f3-aba3-432fd6e5387e/action" status: 202 len: 0 microversion: 2.1 time: 0.098367 Oct 31 19:24:46.643405 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 262/519] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 31 19:24:46 2022] POST /compute/v2.1/servers/ecd39339-b802-43f3-aba3-432fd6e5387e/action => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 19:24:46.649124 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-777d4a7f-5c88-410b-9490-68bb19e3821e tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:24:46.649754 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-777d4a7f-5c88-410b-9490-68bb19e3821e tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] [instance: ecd39339-b802-43f3-aba3-432fd6e5387e] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:24:46.656056 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-777d4a7f-5c88-410b-9490-68bb19e3821e tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:46.656533 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-777d4a7f-5c88-410b-9490-68bb19e3821e tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:46.656964 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-777d4a7f-5c88-410b-9490-68bb19e3821e tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:46.657664 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-777d4a7f-5c88-410b-9490-68bb19e3821e tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:46.658116 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-777d4a7f-5c88-410b-9490-68bb19e3821e tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:46.658532 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-777d4a7f-5c88-410b-9490-68bb19e3821e tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:46.806069 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-777d4a7f-5c88-410b-9490-68bb19e3821e tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b652cca4b94e188b7362606edabb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47ae1789d284a72bb71a6ffe55e7d8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:24:46.814322 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-777d4a7f-5c88-410b-9490-68bb19e3821e tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] 10.222.0.16 "GET /compute/v2.1/servers/ecd39339-b802-43f3-aba3-432fd6e5387e" status: 200 len: 1752 microversion: 2.1 time: 0.169537 Oct 31 19:24:46.814904 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 258/520] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:24:46 2022] GET /compute/v2.1/servers/ecd39339-b802-43f3-aba3-432fd6e5387e => generated 1752 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:24:47.564402 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-27ce92d2-f3d0-4f33-8381-5fc97b80159c tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:24:47.565090 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-27ce92d2-f3d0-4f33-8381-5fc97b80159c tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 3097dda0-1cb7-439c-b44a-898c488a6448] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:24:47.571092 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-27ce92d2-f3d0-4f33-8381-5fc97b80159c tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:47.571596 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-27ce92d2-f3d0-4f33-8381-5fc97b80159c tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:47.572025 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-27ce92d2-f3d0-4f33-8381-5fc97b80159c tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:47.572731 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-27ce92d2-f3d0-4f33-8381-5fc97b80159c tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:47.573178 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-27ce92d2-f3d0-4f33-8381-5fc97b80159c tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:47.573594 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-27ce92d2-f3d0-4f33-8381-5fc97b80159c tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:47.586512 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-d9c0bac5-7db9-43bb-8088-5573c9d25350 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:24:47.587484 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-d9c0bac5-7db9-43bb-8088-5573c9d25350 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] [instance: 0a122a08-bc0f-40fd-8139-74c9e8a70ebe] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:24:47.596044 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-d9c0bac5-7db9-43bb-8088-5573c9d25350 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:47.596702 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-d9c0bac5-7db9-43bb-8088-5573c9d25350 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:47.597410 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-d9c0bac5-7db9-43bb-8088-5573c9d25350 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:47.598474 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-d9c0bac5-7db9-43bb-8088-5573c9d25350 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:47.599538 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-d9c0bac5-7db9-43bb-8088-5573c9d25350 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:47.600066 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-d9c0bac5-7db9-43bb-8088-5573c9d25350 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:47.736894 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-d9c0bac5-7db9-43bb-8088-5573c9d25350 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ece6ca9374764214bac6263bd691bc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9c317b548b40deb8cb27236d36d674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:24:47.745324 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-d9c0bac5-7db9-43bb-8088-5573c9d25350 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] 10.222.0.16 "GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe" status: 200 len: 1675 microversion: 2.1 time: 0.163143 Oct 31 19:24:47.745921 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 259/521] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:24:47 2022] GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe => generated 1675 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:24:47.786906 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-27ce92d2-f3d0-4f33-8381-5fc97b80159c tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc49f9eb3114759b2889ed8972136d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cf63c76fc543428404002ae9a75b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:24:47.795555 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-27ce92d2-f3d0-4f33-8381-5fc97b80159c tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/3097dda0-1cb7-439c-b44a-898c488a6448" status: 200 len: 1733 microversion: 2.1 time: 0.235834 Oct 31 19:24:47.796134 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 263/522] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:24:47 2022] GET /compute/v2.1/servers/3097dda0-1cb7-439c-b44a-898c488a6448 => generated 1733 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:24:47.838736 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-d27b3672-4b1b-43cb-8eeb-edabfa9f50fc tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:24:47.839347 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-d27b3672-4b1b-43cb-8eeb-edabfa9f50fc tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] [instance: ecd39339-b802-43f3-aba3-432fd6e5387e] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:24:47.845161 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-d27b3672-4b1b-43cb-8eeb-edabfa9f50fc tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:47.845692 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-d27b3672-4b1b-43cb-8eeb-edabfa9f50fc tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:47.846130 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-d27b3672-4b1b-43cb-8eeb-edabfa9f50fc tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:47.846824 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-d27b3672-4b1b-43cb-8eeb-edabfa9f50fc tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:47.847281 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-d27b3672-4b1b-43cb-8eeb-edabfa9f50fc tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:47.847704 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-d27b3672-4b1b-43cb-8eeb-edabfa9f50fc tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:47.985959 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-d27b3672-4b1b-43cb-8eeb-edabfa9f50fc tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b652cca4b94e188b7362606edabb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47ae1789d284a72bb71a6ffe55e7d8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:24:47.994964 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-d27b3672-4b1b-43cb-8eeb-edabfa9f50fc tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] 10.222.0.16 "GET /compute/v2.1/servers/ecd39339-b802-43f3-aba3-432fd6e5387e" status: 200 len: 1757 microversion: 2.1 time: 0.160069 Oct 31 19:24:47.998042 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 260/523] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:24:47 2022] GET /compute/v2.1/servers/ecd39339-b802-43f3-aba3-432fd6e5387e => generated 1757 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:24:48.768105 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-66014387-0e3f-4cab-ac35-2cb76244d56a tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:24:48.768719 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-66014387-0e3f-4cab-ac35-2cb76244d56a tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] [instance: 0a122a08-bc0f-40fd-8139-74c9e8a70ebe] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:24:48.775531 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-66014387-0e3f-4cab-ac35-2cb76244d56a tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:48.776013 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-66014387-0e3f-4cab-ac35-2cb76244d56a tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:48.776447 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-66014387-0e3f-4cab-ac35-2cb76244d56a tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:48.777137 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-66014387-0e3f-4cab-ac35-2cb76244d56a tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:48.777589 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-66014387-0e3f-4cab-ac35-2cb76244d56a tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:48.778194 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-66014387-0e3f-4cab-ac35-2cb76244d56a tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:48.818811 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-3a40ad06-f029-461e-b522-8e9715a97615 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:24:48.819425 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-3a40ad06-f029-461e-b522-8e9715a97615 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 3097dda0-1cb7-439c-b44a-898c488a6448] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:24:48.825820 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-3a40ad06-f029-461e-b522-8e9715a97615 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:48.826306 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-3a40ad06-f029-461e-b522-8e9715a97615 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:48.826738 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-3a40ad06-f029-461e-b522-8e9715a97615 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:48.827428 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-3a40ad06-f029-461e-b522-8e9715a97615 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:48.827881 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-3a40ad06-f029-461e-b522-8e9715a97615 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:48.828302 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-3a40ad06-f029-461e-b522-8e9715a97615 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:48.843558 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG dbcounter [-] [118726] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:24:48.910694 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-66014387-0e3f-4cab-ac35-2cb76244d56a tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ece6ca9374764214bac6263bd691bc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9c317b548b40deb8cb27236d36d674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:24:48.918929 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-66014387-0e3f-4cab-ac35-2cb76244d56a tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] 10.222.0.16 "GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe" status: 200 len: 1675 microversion: 2.1 time: 0.154625 Oct 31 19:24:48.919495 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 264/524] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:24:48 2022] GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe => generated 1675 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:24:48.964197 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-3a40ad06-f029-461e-b522-8e9715a97615 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc49f9eb3114759b2889ed8972136d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cf63c76fc543428404002ae9a75b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:24:48.972526 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-3a40ad06-f029-461e-b522-8e9715a97615 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/3097dda0-1cb7-439c-b44a-898c488a6448" status: 200 len: 1733 microversion: 2.1 time: 0.157991 Oct 31 19:24:48.973092 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 261/525] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:24:48 2022] GET /compute/v2.1/servers/3097dda0-1cb7-439c-b44a-898c488a6448 => generated 1733 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 19:24:49.019217 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-edc46cdd-8576-42e4-a362-c034007e7bc3 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:24:49.019823 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-edc46cdd-8576-42e4-a362-c034007e7bc3 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] [instance: ecd39339-b802-43f3-aba3-432fd6e5387e] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:24:49.025628 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-edc46cdd-8576-42e4-a362-c034007e7bc3 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:49.026108 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-edc46cdd-8576-42e4-a362-c034007e7bc3 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:49.026536 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-edc46cdd-8576-42e4-a362-c034007e7bc3 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:49.027217 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-edc46cdd-8576-42e4-a362-c034007e7bc3 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:49.027666 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-edc46cdd-8576-42e4-a362-c034007e7bc3 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:49.028085 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-edc46cdd-8576-42e4-a362-c034007e7bc3 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:49.169746 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-edc46cdd-8576-42e4-a362-c034007e7bc3 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b652cca4b94e188b7362606edabb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47ae1789d284a72bb71a6ffe55e7d8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:24:49.178420 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-edc46cdd-8576-42e4-a362-c034007e7bc3 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] 10.222.0.16 "GET /compute/v2.1/servers/ecd39339-b802-43f3-aba3-432fd6e5387e" status: 200 len: 1757 microversion: 2.1 time: 0.163427 Oct 31 19:24:49.178992 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 265/526] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:24:49 2022] GET /compute/v2.1/servers/ecd39339-b802-43f3-aba3-432fd6e5387e => generated 1757 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:24:49.941964 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-919f7c5e-6c93-40cb-b8ea-0b19e367a7c0 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:24:49.942574 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-919f7c5e-6c93-40cb-b8ea-0b19e367a7c0 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] [instance: 0a122a08-bc0f-40fd-8139-74c9e8a70ebe] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:24:49.949285 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-919f7c5e-6c93-40cb-b8ea-0b19e367a7c0 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:49.949809 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-919f7c5e-6c93-40cb-b8ea-0b19e367a7c0 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:49.950248 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-919f7c5e-6c93-40cb-b8ea-0b19e367a7c0 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:49.950955 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-919f7c5e-6c93-40cb-b8ea-0b19e367a7c0 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:49.951397 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-919f7c5e-6c93-40cb-b8ea-0b19e367a7c0 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:49.951823 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-919f7c5e-6c93-40cb-b8ea-0b19e367a7c0 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:49.995465 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-f9d89bbb-559d-4942-8f0e-c724d526c76b tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:24:49.996013 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-f9d89bbb-559d-4942-8f0e-c724d526c76b tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 3097dda0-1cb7-439c-b44a-898c488a6448] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:24:50.002693 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-f9d89bbb-559d-4942-8f0e-c724d526c76b tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:50.003187 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-f9d89bbb-559d-4942-8f0e-c724d526c76b tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:50.003628 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-f9d89bbb-559d-4942-8f0e-c724d526c76b tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:50.004331 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-f9d89bbb-559d-4942-8f0e-c724d526c76b tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:50.004802 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-f9d89bbb-559d-4942-8f0e-c724d526c76b tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:50.005219 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-f9d89bbb-559d-4942-8f0e-c724d526c76b tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:50.082300 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-919f7c5e-6c93-40cb-b8ea-0b19e367a7c0 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ece6ca9374764214bac6263bd691bc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9c317b548b40deb8cb27236d36d674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:24:50.091580 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-919f7c5e-6c93-40cb-b8ea-0b19e367a7c0 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] 10.222.0.16 "GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe" status: 200 len: 1675 microversion: 2.1 time: 0.153368 Oct 31 19:24:50.092238 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 262/527] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:24:49 2022] GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe => generated 1675 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:24:50.139119 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-f9d89bbb-559d-4942-8f0e-c724d526c76b tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc49f9eb3114759b2889ed8972136d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cf63c76fc543428404002ae9a75b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:24:50.147965 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-f9d89bbb-559d-4942-8f0e-c724d526c76b tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/3097dda0-1cb7-439c-b44a-898c488a6448" status: 200 len: 1733 microversion: 2.1 time: 0.156370 Oct 31 19:24:50.148540 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 266/528] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:24:49 2022] GET /compute/v2.1/servers/3097dda0-1cb7-439c-b44a-898c488a6448 => generated 1733 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 19:24:50.201274 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-cfd514a1-b29e-46a8-86ec-e0ebc0cb2fd4 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:24:50.201916 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-cfd514a1-b29e-46a8-86ec-e0ebc0cb2fd4 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] [instance: ecd39339-b802-43f3-aba3-432fd6e5387e] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:24:50.208486 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-cfd514a1-b29e-46a8-86ec-e0ebc0cb2fd4 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:50.208963 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-cfd514a1-b29e-46a8-86ec-e0ebc0cb2fd4 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:50.209391 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-cfd514a1-b29e-46a8-86ec-e0ebc0cb2fd4 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:50.210115 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-cfd514a1-b29e-46a8-86ec-e0ebc0cb2fd4 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:50.210561 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-cfd514a1-b29e-46a8-86ec-e0ebc0cb2fd4 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:50.211044 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-cfd514a1-b29e-46a8-86ec-e0ebc0cb2fd4 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:50.353639 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-cfd514a1-b29e-46a8-86ec-e0ebc0cb2fd4 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b652cca4b94e188b7362606edabb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47ae1789d284a72bb71a6ffe55e7d8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:24:50.361657 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-cfd514a1-b29e-46a8-86ec-e0ebc0cb2fd4 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] 10.222.0.16 "GET /compute/v2.1/servers/ecd39339-b802-43f3-aba3-432fd6e5387e" status: 200 len: 1757 microversion: 2.1 time: 0.164294 Oct 31 19:24:50.362220 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 263/529] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:24:50 2022] GET /compute/v2.1/servers/ecd39339-b802-43f3-aba3-432fd6e5387e => generated 1757 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 19:24:51.115713 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-e61c6b98-fa68-4fcf-88c5-13e4d77087f5 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:24:51.116316 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-e61c6b98-fa68-4fcf-88c5-13e4d77087f5 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] [instance: 0a122a08-bc0f-40fd-8139-74c9e8a70ebe] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:24:51.122556 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-e61c6b98-fa68-4fcf-88c5-13e4d77087f5 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:51.123035 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-e61c6b98-fa68-4fcf-88c5-13e4d77087f5 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:51.123464 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-e61c6b98-fa68-4fcf-88c5-13e4d77087f5 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:51.124140 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-e61c6b98-fa68-4fcf-88c5-13e4d77087f5 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:51.124588 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-e61c6b98-fa68-4fcf-88c5-13e4d77087f5 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:51.125006 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-e61c6b98-fa68-4fcf-88c5-13e4d77087f5 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:51.172105 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-d1e927c5-372f-4822-9605-1838ac0b5f54 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:24:51.172752 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-d1e927c5-372f-4822-9605-1838ac0b5f54 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 3097dda0-1cb7-439c-b44a-898c488a6448] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:24:51.179798 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-d1e927c5-372f-4822-9605-1838ac0b5f54 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:51.180286 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-d1e927c5-372f-4822-9605-1838ac0b5f54 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:51.180722 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-d1e927c5-372f-4822-9605-1838ac0b5f54 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:51.181412 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-d1e927c5-372f-4822-9605-1838ac0b5f54 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:51.181891 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-d1e927c5-372f-4822-9605-1838ac0b5f54 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:51.182315 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-d1e927c5-372f-4822-9605-1838ac0b5f54 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:51.279828 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-e61c6b98-fa68-4fcf-88c5-13e4d77087f5 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ece6ca9374764214bac6263bd691bc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9c317b548b40deb8cb27236d36d674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:24:51.289791 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-e61c6b98-fa68-4fcf-88c5-13e4d77087f5 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] 10.222.0.16 "GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe" status: 200 len: 1675 microversion: 2.1 time: 0.178447 Oct 31 19:24:51.290959 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 267/530] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:24:51 2022] GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe => generated 1675 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:24:51.325214 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-d1e927c5-372f-4822-9605-1838ac0b5f54 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc49f9eb3114759b2889ed8972136d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cf63c76fc543428404002ae9a75b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:24:51.334102 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-d1e927c5-372f-4822-9605-1838ac0b5f54 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/3097dda0-1cb7-439c-b44a-898c488a6448" status: 200 len: 1733 microversion: 2.1 time: 0.165825 Oct 31 19:24:51.337697 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 264/531] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:24:51 2022] GET /compute/v2.1/servers/3097dda0-1cb7-439c-b44a-898c488a6448 => generated 1733 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 19:24:51.385380 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-a357c747-bf16-45a6-9782-bc643ceb763f tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:24:51.386046 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-a357c747-bf16-45a6-9782-bc643ceb763f tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] [instance: ecd39339-b802-43f3-aba3-432fd6e5387e] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:24:51.391998 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-a357c747-bf16-45a6-9782-bc643ceb763f tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:51.392482 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-a357c747-bf16-45a6-9782-bc643ceb763f tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:51.392916 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-a357c747-bf16-45a6-9782-bc643ceb763f tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:51.393632 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-a357c747-bf16-45a6-9782-bc643ceb763f tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:51.394102 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-a357c747-bf16-45a6-9782-bc643ceb763f tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:51.394529 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-a357c747-bf16-45a6-9782-bc643ceb763f tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:51.543855 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-a357c747-bf16-45a6-9782-bc643ceb763f tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b652cca4b94e188b7362606edabb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47ae1789d284a72bb71a6ffe55e7d8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:24:51.551913 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-a357c747-bf16-45a6-9782-bc643ceb763f tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] 10.222.0.16 "GET /compute/v2.1/servers/ecd39339-b802-43f3-aba3-432fd6e5387e" status: 200 len: 1757 microversion: 2.1 time: 0.171296 Oct 31 19:24:51.552472 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 268/532] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:24:51 2022] GET /compute/v2.1/servers/ecd39339-b802-43f3-aba3-432fd6e5387e => generated 1757 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:24:52.313335 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-c535ce5c-dcc9-490e-af55-823b6821a223 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:24:52.313963 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-c535ce5c-dcc9-490e-af55-823b6821a223 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] [instance: 0a122a08-bc0f-40fd-8139-74c9e8a70ebe] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:24:52.320901 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-c535ce5c-dcc9-490e-af55-823b6821a223 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:52.321377 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-c535ce5c-dcc9-490e-af55-823b6821a223 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:52.321841 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-c535ce5c-dcc9-490e-af55-823b6821a223 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:52.322519 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-c535ce5c-dcc9-490e-af55-823b6821a223 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:52.322966 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-c535ce5c-dcc9-490e-af55-823b6821a223 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:52.323382 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-c535ce5c-dcc9-490e-af55-823b6821a223 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:52.357690 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-129e0fb7-c1a6-4728-bfdb-91bdf32854d5 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:24:52.358236 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-129e0fb7-c1a6-4728-bfdb-91bdf32854d5 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 3097dda0-1cb7-439c-b44a-898c488a6448] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:24:52.365287 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-129e0fb7-c1a6-4728-bfdb-91bdf32854d5 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:52.365810 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-129e0fb7-c1a6-4728-bfdb-91bdf32854d5 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:52.366249 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-129e0fb7-c1a6-4728-bfdb-91bdf32854d5 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:52.366949 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-129e0fb7-c1a6-4728-bfdb-91bdf32854d5 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:52.367404 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-129e0fb7-c1a6-4728-bfdb-91bdf32854d5 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:52.367830 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-129e0fb7-c1a6-4728-bfdb-91bdf32854d5 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:52.454336 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-c535ce5c-dcc9-490e-af55-823b6821a223 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ece6ca9374764214bac6263bd691bc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9c317b548b40deb8cb27236d36d674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:24:52.462363 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-c535ce5c-dcc9-490e-af55-823b6821a223 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] 10.222.0.16 "GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe" status: 200 len: 1675 microversion: 2.1 time: 0.152773 Oct 31 19:24:52.462936 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 265/533] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:24:52 2022] GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe => generated 1675 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:24:52.499469 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-129e0fb7-c1a6-4728-bfdb-91bdf32854d5 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc49f9eb3114759b2889ed8972136d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cf63c76fc543428404002ae9a75b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:24:52.507769 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-129e0fb7-c1a6-4728-bfdb-91bdf32854d5 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/3097dda0-1cb7-439c-b44a-898c488a6448" status: 200 len: 1733 microversion: 2.1 time: 0.153924 Oct 31 19:24:52.508336 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 269/534] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:24:52 2022] GET /compute/v2.1/servers/3097dda0-1cb7-439c-b44a-898c488a6448 => generated 1733 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 19:24:52.575547 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-5ad6f900-1675-45e7-99d7-d44e111d3b3a tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:24:52.576133 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-5ad6f900-1675-45e7-99d7-d44e111d3b3a tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] [instance: ecd39339-b802-43f3-aba3-432fd6e5387e] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:24:52.581888 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-5ad6f900-1675-45e7-99d7-d44e111d3b3a tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:52.582356 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-5ad6f900-1675-45e7-99d7-d44e111d3b3a tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:52.582803 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-5ad6f900-1675-45e7-99d7-d44e111d3b3a tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:52.583458 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-5ad6f900-1675-45e7-99d7-d44e111d3b3a tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:52.583904 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-5ad6f900-1675-45e7-99d7-d44e111d3b3a tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:52.584349 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-5ad6f900-1675-45e7-99d7-d44e111d3b3a tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:52.724218 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-5ad6f900-1675-45e7-99d7-d44e111d3b3a tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b652cca4b94e188b7362606edabb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47ae1789d284a72bb71a6ffe55e7d8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:24:52.732356 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-5ad6f900-1675-45e7-99d7-d44e111d3b3a tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] 10.222.0.16 "GET /compute/v2.1/servers/ecd39339-b802-43f3-aba3-432fd6e5387e" status: 200 len: 1757 microversion: 2.1 time: 0.160770 Oct 31 19:24:52.732924 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 266/535] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:24:52 2022] GET /compute/v2.1/servers/ecd39339-b802-43f3-aba3-432fd6e5387e => generated 1757 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:24:53.486041 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-0e47ce59-2353-44a6-b170-5f52fa6c184a tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:24:53.486600 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-0e47ce59-2353-44a6-b170-5f52fa6c184a tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] [instance: 0a122a08-bc0f-40fd-8139-74c9e8a70ebe] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:24:53.493325 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-0e47ce59-2353-44a6-b170-5f52fa6c184a tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:53.493836 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-0e47ce59-2353-44a6-b170-5f52fa6c184a tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:53.494265 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-0e47ce59-2353-44a6-b170-5f52fa6c184a tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:53.494945 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-0e47ce59-2353-44a6-b170-5f52fa6c184a tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:53.495390 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-0e47ce59-2353-44a6-b170-5f52fa6c184a tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:53.495808 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-0e47ce59-2353-44a6-b170-5f52fa6c184a tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:53.530528 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-74ac929b-552d-44b8-8a75-27e0d4d1a85f tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:24:53.531131 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-74ac929b-552d-44b8-8a75-27e0d4d1a85f tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 3097dda0-1cb7-439c-b44a-898c488a6448] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:24:53.537649 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-74ac929b-552d-44b8-8a75-27e0d4d1a85f tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:53.538128 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-74ac929b-552d-44b8-8a75-27e0d4d1a85f tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:53.538557 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-74ac929b-552d-44b8-8a75-27e0d4d1a85f tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:53.539243 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-74ac929b-552d-44b8-8a75-27e0d4d1a85f tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:53.539693 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-74ac929b-552d-44b8-8a75-27e0d4d1a85f tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:53.540109 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-74ac929b-552d-44b8-8a75-27e0d4d1a85f tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:53.622515 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-0e47ce59-2353-44a6-b170-5f52fa6c184a tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ece6ca9374764214bac6263bd691bc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9c317b548b40deb8cb27236d36d674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:24:53.630930 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-0e47ce59-2353-44a6-b170-5f52fa6c184a tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] 10.222.0.16 "GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe" status: 200 len: 1675 microversion: 2.1 time: 0.148849 Oct 31 19:24:53.631512 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 270/536] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:24:53 2022] GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe => generated 1675 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:24:53.670273 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-74ac929b-552d-44b8-8a75-27e0d4d1a85f tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc49f9eb3114759b2889ed8972136d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cf63c76fc543428404002ae9a75b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:24:53.678888 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-74ac929b-552d-44b8-8a75-27e0d4d1a85f tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/3097dda0-1cb7-439c-b44a-898c488a6448" status: 200 len: 1733 microversion: 2.1 time: 0.152181 Oct 31 19:24:53.679477 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 267/537] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:24:53 2022] GET /compute/v2.1/servers/3097dda0-1cb7-439c-b44a-898c488a6448 => generated 1733 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 19:24:53.756095 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-ff410c53-8cd7-490d-9004-3badec503639 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:24:53.756618 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-ff410c53-8cd7-490d-9004-3badec503639 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] [instance: ecd39339-b802-43f3-aba3-432fd6e5387e] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:24:53.762427 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-ff410c53-8cd7-490d-9004-3badec503639 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:53.762903 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-ff410c53-8cd7-490d-9004-3badec503639 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:53.763331 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-ff410c53-8cd7-490d-9004-3badec503639 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:53.764006 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-ff410c53-8cd7-490d-9004-3badec503639 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:53.764453 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-ff410c53-8cd7-490d-9004-3badec503639 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:53.764871 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-ff410c53-8cd7-490d-9004-3badec503639 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:53.904705 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-ff410c53-8cd7-490d-9004-3badec503639 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b652cca4b94e188b7362606edabb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47ae1789d284a72bb71a6ffe55e7d8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:24:53.913456 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-ff410c53-8cd7-490d-9004-3badec503639 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] 10.222.0.16 "GET /compute/v2.1/servers/ecd39339-b802-43f3-aba3-432fd6e5387e" status: 200 len: 1757 microversion: 2.1 time: 0.161857 Oct 31 19:24:53.914064 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 271/538] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:24:53 2022] GET /compute/v2.1/servers/ecd39339-b802-43f3-aba3-432fd6e5387e => generated 1757 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:24:54.653665 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-dd9b2741-d277-46bc-80dc-c9495f4ad047 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:24:54.654276 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-dd9b2741-d277-46bc-80dc-c9495f4ad047 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] [instance: 0a122a08-bc0f-40fd-8139-74c9e8a70ebe] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:24:54.660641 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-dd9b2741-d277-46bc-80dc-c9495f4ad047 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:54.661119 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-dd9b2741-d277-46bc-80dc-c9495f4ad047 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:54.661548 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-dd9b2741-d277-46bc-80dc-c9495f4ad047 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:54.662257 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-dd9b2741-d277-46bc-80dc-c9495f4ad047 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:54.662712 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-dd9b2741-d277-46bc-80dc-c9495f4ad047 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:54.663135 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-dd9b2741-d277-46bc-80dc-c9495f4ad047 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:54.702305 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-2f905c66-ab18-4e48-86b4-31409bb4c007 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:24:54.702919 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-2f905c66-ab18-4e48-86b4-31409bb4c007 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 3097dda0-1cb7-439c-b44a-898c488a6448] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:24:54.709246 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-2f905c66-ab18-4e48-86b4-31409bb4c007 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:54.709764 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-2f905c66-ab18-4e48-86b4-31409bb4c007 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:54.710388 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-2f905c66-ab18-4e48-86b4-31409bb4c007 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:54.711113 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-2f905c66-ab18-4e48-86b4-31409bb4c007 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:54.712203 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-2f905c66-ab18-4e48-86b4-31409bb4c007 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:54.712677 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-2f905c66-ab18-4e48-86b4-31409bb4c007 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:54.799870 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-dd9b2741-d277-46bc-80dc-c9495f4ad047 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ece6ca9374764214bac6263bd691bc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9c317b548b40deb8cb27236d36d674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:24:54.808689 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-dd9b2741-d277-46bc-80dc-c9495f4ad047 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] 10.222.0.16 "GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe" status: 200 len: 1675 microversion: 2.1 time: 0.158700 Oct 31 19:24:54.809367 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 268/539] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:24:54 2022] GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe => generated 1675 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:24:54.844352 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-2f905c66-ab18-4e48-86b4-31409bb4c007 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc49f9eb3114759b2889ed8972136d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cf63c76fc543428404002ae9a75b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:24:54.852523 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-2f905c66-ab18-4e48-86b4-31409bb4c007 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/3097dda0-1cb7-439c-b44a-898c488a6448" status: 200 len: 1733 microversion: 2.1 time: 0.153983 Oct 31 19:24:54.853089 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 272/540] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:24:54 2022] GET /compute/v2.1/servers/3097dda0-1cb7-439c-b44a-898c488a6448 => generated 1733 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 19:24:54.937830 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-5c4d13fa-f31f-4da3-b3b1-c1c700730484 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:24:54.938359 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-5c4d13fa-f31f-4da3-b3b1-c1c700730484 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] [instance: ecd39339-b802-43f3-aba3-432fd6e5387e] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:24:54.945557 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-5c4d13fa-f31f-4da3-b3b1-c1c700730484 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:54.946064 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-5c4d13fa-f31f-4da3-b3b1-c1c700730484 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:54.946495 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-5c4d13fa-f31f-4da3-b3b1-c1c700730484 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:54.947189 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-5c4d13fa-f31f-4da3-b3b1-c1c700730484 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:54.947649 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-5c4d13fa-f31f-4da3-b3b1-c1c700730484 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:54.948074 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-5c4d13fa-f31f-4da3-b3b1-c1c700730484 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:55.096096 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-5c4d13fa-f31f-4da3-b3b1-c1c700730484 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b652cca4b94e188b7362606edabb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47ae1789d284a72bb71a6ffe55e7d8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:24:55.104210 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-5c4d13fa-f31f-4da3-b3b1-c1c700730484 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] 10.222.0.16 "GET /compute/v2.1/servers/ecd39339-b802-43f3-aba3-432fd6e5387e" status: 200 len: 1757 microversion: 2.1 time: 0.170358 Oct 31 19:24:55.104773 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 269/541] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:24:54 2022] GET /compute/v2.1/servers/ecd39339-b802-43f3-aba3-432fd6e5387e => generated 1757 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:24:55.831932 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-49fe7d75-1b14-495b-8f4b-79ff643b4982 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:24:55.832578 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-49fe7d75-1b14-495b-8f4b-79ff643b4982 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] [instance: 0a122a08-bc0f-40fd-8139-74c9e8a70ebe] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:24:55.839489 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-49fe7d75-1b14-495b-8f4b-79ff643b4982 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:55.839971 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-49fe7d75-1b14-495b-8f4b-79ff643b4982 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:55.840403 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-49fe7d75-1b14-495b-8f4b-79ff643b4982 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:55.841087 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-49fe7d75-1b14-495b-8f4b-79ff643b4982 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:55.841536 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-49fe7d75-1b14-495b-8f4b-79ff643b4982 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:55.841984 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-49fe7d75-1b14-495b-8f4b-79ff643b4982 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:55.875694 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-05fac5b1-3158-46a8-af72-a2bca025c12a tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:24:55.876388 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-05fac5b1-3158-46a8-af72-a2bca025c12a tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 3097dda0-1cb7-439c-b44a-898c488a6448] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:24:55.883010 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-05fac5b1-3158-46a8-af72-a2bca025c12a tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:55.883490 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-05fac5b1-3158-46a8-af72-a2bca025c12a tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:55.883918 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-05fac5b1-3158-46a8-af72-a2bca025c12a tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:55.884613 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-05fac5b1-3158-46a8-af72-a2bca025c12a tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:55.885069 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-05fac5b1-3158-46a8-af72-a2bca025c12a tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:55.885484 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-05fac5b1-3158-46a8-af72-a2bca025c12a tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:55.975437 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-49fe7d75-1b14-495b-8f4b-79ff643b4982 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ece6ca9374764214bac6263bd691bc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9c317b548b40deb8cb27236d36d674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:24:55.983407 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-49fe7d75-1b14-495b-8f4b-79ff643b4982 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] 10.222.0.16 "GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe" status: 200 len: 1652 microversion: 2.1 time: 0.155245 Oct 31 19:24:55.983985 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 273/542] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:24:55 2022] GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe => generated 1652 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:24:56.005787 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-3602a982-735b-4cde-b90b-9cc5f8de2c86 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:24:56.011747 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-3602a982-735b-4cde-b90b-9cc5f8de2c86 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:56.012273 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-3602a982-735b-4cde-b90b-9cc5f8de2c86 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:56.012711 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-3602a982-735b-4cde-b90b-9cc5f8de2c86 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:56.021087 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-05fac5b1-3158-46a8-af72-a2bca025c12a tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc49f9eb3114759b2889ed8972136d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cf63c76fc543428404002ae9a75b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:24:56.029678 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-05fac5b1-3158-46a8-af72-a2bca025c12a tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/3097dda0-1cb7-439c-b44a-898c488a6448" status: 200 len: 1733 microversion: 2.1 time: 0.157418 Oct 31 19:24:56.030341 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 270/543] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:24:55 2022] GET /compute/v2.1/servers/3097dda0-1cb7-439c-b44a-898c488a6448 => generated 1733 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 19:24:56.035194 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-3602a982-735b-4cde-b90b-9cc5f8de2c86 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] [instance: 0a122a08-bc0f-40fd-8139-74c9e8a70ebe] Going to try to start instance {{(pid=118727) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 31 19:24:56.075268 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-3602a982-735b-4cde-b90b-9cc5f8de2c86 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] 10.222.0.16 "POST /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe/action" status: 202 len: 0 microversion: 2.1 time: 0.073333 Oct 31 19:24:56.075863 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 274/544] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 31 19:24:56 2022] POST /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe/action => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 31 19:24:56.084429 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-22f3edb7-2986-48b2-8678-826c52cc4e2c tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:24:56.085036 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-22f3edb7-2986-48b2-8678-826c52cc4e2c tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] [instance: 0a122a08-bc0f-40fd-8139-74c9e8a70ebe] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:24:56.090933 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-22f3edb7-2986-48b2-8678-826c52cc4e2c tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:56.091419 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-22f3edb7-2986-48b2-8678-826c52cc4e2c tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:56.091851 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-22f3edb7-2986-48b2-8678-826c52cc4e2c tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:56.092533 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-22f3edb7-2986-48b2-8678-826c52cc4e2c tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:56.092984 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-22f3edb7-2986-48b2-8678-826c52cc4e2c tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:56.093405 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-22f3edb7-2986-48b2-8678-826c52cc4e2c tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:56.127376 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-6f911406-30a8-4bb5-8852-274d792501c4 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:24:56.128072 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-6f911406-30a8-4bb5-8852-274d792501c4 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] [instance: ecd39339-b802-43f3-aba3-432fd6e5387e] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:24:56.134809 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-6f911406-30a8-4bb5-8852-274d792501c4 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:56.135289 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-6f911406-30a8-4bb5-8852-274d792501c4 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:56.135727 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-6f911406-30a8-4bb5-8852-274d792501c4 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:56.136414 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-6f911406-30a8-4bb5-8852-274d792501c4 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:56.136866 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-6f911406-30a8-4bb5-8852-274d792501c4 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:56.137290 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-6f911406-30a8-4bb5-8852-274d792501c4 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:56.152438 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG dbcounter [-] [118727] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:24:56.223000 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-22f3edb7-2986-48b2-8678-826c52cc4e2c tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ece6ca9374764214bac6263bd691bc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9c317b548b40deb8cb27236d36d674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:24:56.230745 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-22f3edb7-2986-48b2-8678-826c52cc4e2c tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] 10.222.0.16 "GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe" status: 200 len: 1661 microversion: 2.1 time: 0.150712 Oct 31 19:24:56.231349 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 271/545] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:24:56 2022] GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe => generated 1661 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:24:56.282359 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-6f911406-30a8-4bb5-8852-274d792501c4 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b652cca4b94e188b7362606edabb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47ae1789d284a72bb71a6ffe55e7d8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:24:56.290517 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-6f911406-30a8-4bb5-8852-274d792501c4 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] 10.222.0.16 "GET /compute/v2.1/servers/ecd39339-b802-43f3-aba3-432fd6e5387e" status: 200 len: 1757 microversion: 2.1 time: 0.167241 Oct 31 19:24:56.291077 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 275/546] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:24:56 2022] GET /compute/v2.1/servers/ecd39339-b802-43f3-aba3-432fd6e5387e => generated 1757 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 19:24:57.054022 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-11633414-0472-4884-a0f8-fd3b19783ced tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:24:57.054548 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-11633414-0472-4884-a0f8-fd3b19783ced tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 3097dda0-1cb7-439c-b44a-898c488a6448] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:24:57.060944 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-11633414-0472-4884-a0f8-fd3b19783ced tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:57.061427 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-11633414-0472-4884-a0f8-fd3b19783ced tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:57.061879 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-11633414-0472-4884-a0f8-fd3b19783ced tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:57.062574 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-11633414-0472-4884-a0f8-fd3b19783ced tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:57.063004 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-11633414-0472-4884-a0f8-fd3b19783ced tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:57.063423 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-11633414-0472-4884-a0f8-fd3b19783ced tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:57.187850 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-11633414-0472-4884-a0f8-fd3b19783ced tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc49f9eb3114759b2889ed8972136d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cf63c76fc543428404002ae9a75b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:24:57.195897 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-11633414-0472-4884-a0f8-fd3b19783ced tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/3097dda0-1cb7-439c-b44a-898c488a6448" status: 200 len: 1733 microversion: 2.1 time: 0.146392 Oct 31 19:24:57.196451 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 272/547] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:24:57 2022] GET /compute/v2.1/servers/3097dda0-1cb7-439c-b44a-898c488a6448 => generated 1733 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:24:57.253712 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-eeeac755-5ac1-4f3d-8ef4-86a080f1c9d7 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:24:57.254342 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-eeeac755-5ac1-4f3d-8ef4-86a080f1c9d7 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] [instance: 0a122a08-bc0f-40fd-8139-74c9e8a70ebe] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:24:57.260644 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-eeeac755-5ac1-4f3d-8ef4-86a080f1c9d7 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:57.261113 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-eeeac755-5ac1-4f3d-8ef4-86a080f1c9d7 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:57.261546 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-eeeac755-5ac1-4f3d-8ef4-86a080f1c9d7 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:57.262242 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-eeeac755-5ac1-4f3d-8ef4-86a080f1c9d7 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:57.262687 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-eeeac755-5ac1-4f3d-8ef4-86a080f1c9d7 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:57.263102 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-eeeac755-5ac1-4f3d-8ef4-86a080f1c9d7 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:57.313789 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-e5b2889f-bb54-4bc5-bfad-8aed7e9e7594 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:24:57.314505 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-e5b2889f-bb54-4bc5-bfad-8aed7e9e7594 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] [instance: ecd39339-b802-43f3-aba3-432fd6e5387e] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:24:57.320369 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-e5b2889f-bb54-4bc5-bfad-8aed7e9e7594 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:57.320928 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-e5b2889f-bb54-4bc5-bfad-8aed7e9e7594 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:57.321404 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-e5b2889f-bb54-4bc5-bfad-8aed7e9e7594 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:57.322190 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-e5b2889f-bb54-4bc5-bfad-8aed7e9e7594 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:57.322702 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-e5b2889f-bb54-4bc5-bfad-8aed7e9e7594 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:57.323188 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-e5b2889f-bb54-4bc5-bfad-8aed7e9e7594 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:57.394938 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-eeeac755-5ac1-4f3d-8ef4-86a080f1c9d7 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ece6ca9374764214bac6263bd691bc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9c317b548b40deb8cb27236d36d674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:24:57.403215 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-eeeac755-5ac1-4f3d-8ef4-86a080f1c9d7 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] 10.222.0.16 "GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe" status: 200 len: 1661 microversion: 2.1 time: 0.153308 Oct 31 19:24:57.403988 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 276/548] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:24:57 2022] GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe => generated 1661 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:24:57.468803 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-e5b2889f-bb54-4bc5-bfad-8aed7e9e7594 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b652cca4b94e188b7362606edabb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47ae1789d284a72bb71a6ffe55e7d8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:24:57.477962 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-e5b2889f-bb54-4bc5-bfad-8aed7e9e7594 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] 10.222.0.16 "GET /compute/v2.1/servers/ecd39339-b802-43f3-aba3-432fd6e5387e" status: 200 len: 1757 microversion: 2.1 time: 0.168041 Oct 31 19:24:57.478531 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 273/549] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:24:57 2022] GET /compute/v2.1/servers/ecd39339-b802-43f3-aba3-432fd6e5387e => generated 1757 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 19:24:58.218925 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-a5268f64-4fc1-4448-811b-8b409b41bacc tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:24:58.219529 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-a5268f64-4fc1-4448-811b-8b409b41bacc tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 3097dda0-1cb7-439c-b44a-898c488a6448] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:24:58.226293 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-a5268f64-4fc1-4448-811b-8b409b41bacc tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:58.226774 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-a5268f64-4fc1-4448-811b-8b409b41bacc tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:58.227210 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-a5268f64-4fc1-4448-811b-8b409b41bacc tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:58.227893 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-a5268f64-4fc1-4448-811b-8b409b41bacc tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:58.228344 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-a5268f64-4fc1-4448-811b-8b409b41bacc tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:58.228760 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-a5268f64-4fc1-4448-811b-8b409b41bacc tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:58.357242 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-a5268f64-4fc1-4448-811b-8b409b41bacc tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc49f9eb3114759b2889ed8972136d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cf63c76fc543428404002ae9a75b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:24:58.365503 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-a5268f64-4fc1-4448-811b-8b409b41bacc tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/3097dda0-1cb7-439c-b44a-898c488a6448" status: 200 len: 1733 microversion: 2.1 time: 0.150427 Oct 31 19:24:58.366097 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 277/550] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:24:58 2022] GET /compute/v2.1/servers/3097dda0-1cb7-439c-b44a-898c488a6448 => generated 1733 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:24:58.427014 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-b4ff2ef7-ab8e-46fe-af2f-82975dc40342 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:24:58.427632 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-b4ff2ef7-ab8e-46fe-af2f-82975dc40342 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] [instance: 0a122a08-bc0f-40fd-8139-74c9e8a70ebe] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:24:58.433973 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-b4ff2ef7-ab8e-46fe-af2f-82975dc40342 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:58.434456 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-b4ff2ef7-ab8e-46fe-af2f-82975dc40342 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:58.434888 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-b4ff2ef7-ab8e-46fe-af2f-82975dc40342 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:58.435574 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-b4ff2ef7-ab8e-46fe-af2f-82975dc40342 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:58.436034 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-b4ff2ef7-ab8e-46fe-af2f-82975dc40342 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:58.436457 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-b4ff2ef7-ab8e-46fe-af2f-82975dc40342 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:58.502652 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-84b1cb1a-e285-4256-81e7-bd77e84af3c4 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:24:58.503183 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-84b1cb1a-e285-4256-81e7-bd77e84af3c4 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] [instance: ecd39339-b802-43f3-aba3-432fd6e5387e] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:24:58.509491 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-84b1cb1a-e285-4256-81e7-bd77e84af3c4 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:58.510003 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-84b1cb1a-e285-4256-81e7-bd77e84af3c4 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:58.510438 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-84b1cb1a-e285-4256-81e7-bd77e84af3c4 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:58.511127 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-84b1cb1a-e285-4256-81e7-bd77e84af3c4 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:58.511580 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-84b1cb1a-e285-4256-81e7-bd77e84af3c4 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:58.512003 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-84b1cb1a-e285-4256-81e7-bd77e84af3c4 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:58.572922 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-b4ff2ef7-ab8e-46fe-af2f-82975dc40342 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ece6ca9374764214bac6263bd691bc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9c317b548b40deb8cb27236d36d674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:24:58.584623 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-b4ff2ef7-ab8e-46fe-af2f-82975dc40342 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] 10.222.0.16 "GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe" status: 200 len: 1661 microversion: 2.1 time: 0.160996 Oct 31 19:24:58.585400 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 274/551] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:24:58 2022] GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe => generated 1661 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:24:58.700528 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-84b1cb1a-e285-4256-81e7-bd77e84af3c4 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b652cca4b94e188b7362606edabb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47ae1789d284a72bb71a6ffe55e7d8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:24:58.708912 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-84b1cb1a-e285-4256-81e7-bd77e84af3c4 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] 10.222.0.16 "GET /compute/v2.1/servers/ecd39339-b802-43f3-aba3-432fd6e5387e" status: 200 len: 1757 microversion: 2.1 time: 0.210139 Oct 31 19:24:58.709716 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 278/552] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:24:58 2022] GET /compute/v2.1/servers/ecd39339-b802-43f3-aba3-432fd6e5387e => generated 1757 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 19:24:59.389408 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-3db51348-9316-4a7f-adac-0a8f8380acc4 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:24:59.390064 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-3db51348-9316-4a7f-adac-0a8f8380acc4 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 3097dda0-1cb7-439c-b44a-898c488a6448] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:24:59.396466 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-3db51348-9316-4a7f-adac-0a8f8380acc4 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:59.396943 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-3db51348-9316-4a7f-adac-0a8f8380acc4 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:59.397371 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-3db51348-9316-4a7f-adac-0a8f8380acc4 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:59.398075 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-3db51348-9316-4a7f-adac-0a8f8380acc4 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:59.398532 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-3db51348-9316-4a7f-adac-0a8f8380acc4 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:59.398951 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-3db51348-9316-4a7f-adac-0a8f8380acc4 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:59.531524 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-3db51348-9316-4a7f-adac-0a8f8380acc4 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc49f9eb3114759b2889ed8972136d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cf63c76fc543428404002ae9a75b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:24:59.539675 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-3db51348-9316-4a7f-adac-0a8f8380acc4 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/3097dda0-1cb7-439c-b44a-898c488a6448" status: 200 len: 1713 microversion: 2.1 time: 0.154148 Oct 31 19:24:59.540246 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 275/553] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:24:59 2022] GET /compute/v2.1/servers/3097dda0-1cb7-439c-b44a-898c488a6448 => generated 1713 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:24:59.608582 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-19f0e2ad-457e-45d8-85ef-88fbcdb26a3a tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:24:59.609415 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-19f0e2ad-457e-45d8-85ef-88fbcdb26a3a tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] [instance: 0a122a08-bc0f-40fd-8139-74c9e8a70ebe] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:24:59.616443 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-19f0e2ad-457e-45d8-85ef-88fbcdb26a3a tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:59.616919 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-19f0e2ad-457e-45d8-85ef-88fbcdb26a3a tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:59.617539 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-19f0e2ad-457e-45d8-85ef-88fbcdb26a3a tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:59.618263 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-19f0e2ad-457e-45d8-85ef-88fbcdb26a3a tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:59.618713 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-19f0e2ad-457e-45d8-85ef-88fbcdb26a3a tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:59.619422 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-19f0e2ad-457e-45d8-85ef-88fbcdb26a3a tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:59.694507 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-d23d0fba-bcb1-48d4-93a4-1b391b22162a tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:24:59.695152 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-d23d0fba-bcb1-48d4-93a4-1b391b22162a tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 3097dda0-1cb7-439c-b44a-898c488a6448] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:24:59.701315 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-d23d0fba-bcb1-48d4-93a4-1b391b22162a tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:59.701963 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-d23d0fba-bcb1-48d4-93a4-1b391b22162a tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:59.702494 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-d23d0fba-bcb1-48d4-93a4-1b391b22162a tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:59.703363 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-d23d0fba-bcb1-48d4-93a4-1b391b22162a tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:59.703929 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-d23d0fba-bcb1-48d4-93a4-1b391b22162a tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:59.704604 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-d23d0fba-bcb1-48d4-93a4-1b391b22162a tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:59.832731 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.wsgi [None req-d23d0fba-bcb1-48d4-93a4-1b391b22162a tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] HTTP exception thrown: Cannot 'detach_volume' instance 3097dda0-1cb7-439c-b44a-898c488a6448 while it is in vm_state rescued Oct 31 19:24:59.834385 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-d23d0fba-bcb1-48d4-93a4-1b391b22162a tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Request method failure captured: Oct 31 19:24:59.834385 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: request: DELETE /compute/v2.1/servers/3097dda0-1cb7-439c-b44a-898c488a6448/os-volume_attachments/10dfa9ba-1b6b-498e-b27b-3957452bb604 HTTP/1.1 Oct 31 19:24:59.834385 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: Accept: application/json Oct 31 19:24:59.834385 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: Accept-Encoding: identity Oct 31 19:24:59.834385 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: Connection: close Oct 31 19:24:59.834385 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: Content-Length: 0 Oct 31 19:24:59.834385 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: Content-Type: application/json Oct 31 19:24:59.834385 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: Host: 10.222.0.16 Oct 31 19:24:59.834385 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: Openstack-System-Scope: None Oct 31 19:24:59.834385 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: User-Agent: python-urllib3/1.26.12 Oct 31 19:24:59.834385 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Auth-Token: gAAAAABjYCAUQ8YIOE1LqUgdd-VNJVSMmtJLqLbK8GSGQuylkQibi1W0G15Xlmc42Ab2ILvZHAFaOwUXTuxHL77kGeaOPHnfv7wa7hvLMGAh1mz7JFprCgygCLONv8fHZR7cWDh7VdBpvVSZYSPSFRHB1FTdSs8ZWKVZbGgsG6vqf9BFw1oXMP8 Oct 31 19:24:59.834385 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Domain-Id: None Oct 31 19:24:59.834385 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Domain-Name: None Oct 31 19:24:59.834385 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Identity-Status: Confirmed Oct 31 19:24:59.834385 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Is-Admin-Project: True Oct 31 19:24:59.834385 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Project-Domain-Id: default Oct 31 19:24:59.834385 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Project-Domain-Name: Default Oct 31 19:24:59.834385 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Project-Id: 73cf63c76fc543428404002ae9a75b29 Oct 31 19:24:59.834385 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-466281787 Oct 31 19:24:59.834385 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Role: member,reader Oct 31 19:24:59.834385 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Roles: member,reader Oct 31 19:24:59.835981 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/73cf63c76fc543428404002ae9a75b29"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_73cf63c76fc543428404002ae9a75b29", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/73cf63c76fc543428404002ae9a75b29"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/73cf63c76fc543428404002ae9a75b29"}]}] Oct 31 19:24:59.835981 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Tenant: tempest-ServerRescueNegativeTestJSON-466281787 Oct 31 19:24:59.835981 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Tenant-Id: 73cf63c76fc543428404002ae9a75b29 Oct 31 19:24:59.835981 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-466281787 Oct 31 19:24:59.835981 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-User: tempest-ServerRescueNegativeTestJSON-466281787-project Oct 31 19:24:59.835981 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-User-Domain-Id: default Oct 31 19:24:59.835981 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-User-Domain-Name: Default Oct 31 19:24:59.835981 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-User-Id: ddc49f9eb3114759b2889ed8972136d8 Oct 31 19:24:59.835981 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-User-Name: tempest-ServerRescueNegativeTestJSON-466281787-project Oct 31 19:24:59.835981 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: method: > Oct 31 19:24:59.835981 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: exception: Cannot 'detach_volume' instance 3097dda0-1cb7-439c-b44a-898c488a6448 while it is in vm_state rescued Oct 31 19:24:59.836708 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: action_args: {'server_id': '3097dda0-1cb7-439c-b44a-898c488a6448', 'id': '10dfa9ba-1b6b-498e-b27b-3957452bb604'} Oct 31 19:24:59.836708 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 19:24:59.836708 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:24:59.836708 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Oct 31 19:24:59.836708 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Oct 31 19:24:59.836708 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 31 19:24:59.836708 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 31 19:24:59.836708 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 31 19:24:59.836708 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 31 19:24:59.836708 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 3097dda0-1cb7-439c-b44a-898c488a6448 in vm_state rescued. Cannot detach_volume while the instance is in this state. Oct 31 19:24:59.836708 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Oct 31 19:24:59.836708 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 19:24:59.836708 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Oct 31 19:24:59.836708 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:24:59.836708 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 19:24:59.836708 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 19:24:59.836708 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 19:24:59.836708 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 19:24:59.836708 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 19:24:59.836708 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 19:24:59.838032 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Oct 31 19:24:59.838032 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 31 19:24:59.838032 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 31 19:24:59.838032 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 31 19:24:59.838032 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 3097dda0-1cb7-439c-b44a-898c488a6448 while it is in vm_state rescued Oct 31 19:24:59.838032 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Oct 31 19:24:59.838032 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 19:24:59.838032 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Oct 31 19:24:59.838032 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:24:59.838032 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 19:24:59.838032 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 19:24:59.838032 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 19:24:59.838032 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 19:24:59.838032 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 3097dda0-1cb7-439c-b44a-898c488a6448 while it is in vm_state rescued Oct 31 19:24:59.838032 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Oct 31 19:24:59.838032 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-d23d0fba-bcb1-48d4-93a4-1b391b22162a tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Returning 409 to user: Cannot 'detach_volume' instance 3097dda0-1cb7-439c-b44a-898c488a6448 while it is in vm_state rescued {{(pid=118726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 19:24:59.839027 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-d23d0fba-bcb1-48d4-93a4-1b391b22162a tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "DELETE /compute/v2.1/servers/3097dda0-1cb7-439c-b44a-898c488a6448/os-volume_attachments/10dfa9ba-1b6b-498e-b27b-3957452bb604" status: 409 len: 152 microversion: 2.1 time: 0.147346 Oct 31 19:24:59.839027 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 276/554] 10.222.0.16 () {58 vars in 1416 bytes} [Mon Oct 31 19:24:59 2022] DELETE /compute/v2.1/servers/3097dda0-1cb7-439c-b44a-898c488a6448/os-volume_attachments/10dfa9ba-1b6b-498e-b27b-3957452bb604 => generated 152 bytes in 149 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 31 19:24:59.843179 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-0d3183cf-31bc-4259-81cc-e05266be03a7 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:24:59.843785 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-0d3183cf-31bc-4259-81cc-e05266be03a7 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] [instance: ecd39339-b802-43f3-aba3-432fd6e5387e] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:24:59.850773 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-0d3183cf-31bc-4259-81cc-e05266be03a7 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:59.851278 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-0d3183cf-31bc-4259-81cc-e05266be03a7 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:59.851680 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-0d3183cf-31bc-4259-81cc-e05266be03a7 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:59.852376 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-0d3183cf-31bc-4259-81cc-e05266be03a7 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:59.853338 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-0d3183cf-31bc-4259-81cc-e05266be03a7 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:59.853338 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-0d3183cf-31bc-4259-81cc-e05266be03a7 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:59.853654 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-19f0e2ad-457e-45d8-85ef-88fbcdb26a3a tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ece6ca9374764214bac6263bd691bc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9c317b548b40deb8cb27236d36d674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:24:59.863000 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-19f0e2ad-457e-45d8-85ef-88fbcdb26a3a tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] 10.222.0.16 "GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe" status: 200 len: 1661 microversion: 2.1 time: 0.258268 Oct 31 19:24:59.863581 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 279/555] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:24:59 2022] GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe => generated 1661 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 19:24:59.868185 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-438b6d82-62a9-4fdc-ae95-37e68fd44e1d tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:24:59.868899 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-438b6d82-62a9-4fdc-ae95-37e68fd44e1d tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 3097dda0-1cb7-439c-b44a-898c488a6448] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:24:59.875473 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-438b6d82-62a9-4fdc-ae95-37e68fd44e1d tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:59.876192 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-438b6d82-62a9-4fdc-ae95-37e68fd44e1d tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:59.876620 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-438b6d82-62a9-4fdc-ae95-37e68fd44e1d tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:59.877489 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-438b6d82-62a9-4fdc-ae95-37e68fd44e1d tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:59.878120 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-438b6d82-62a9-4fdc-ae95-37e68fd44e1d tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:59.878701 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-438b6d82-62a9-4fdc-ae95-37e68fd44e1d tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:59.945373 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-438b6d82-62a9-4fdc-ae95-37e68fd44e1d tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "POST /compute/v2.1/servers/3097dda0-1cb7-439c-b44a-898c488a6448/action" status: 202 len: 0 microversion: 2.1 time: 0.080608 Oct 31 19:24:59.949178 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 280/556] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 31 19:24:59 2022] POST /compute/v2.1/servers/3097dda0-1cb7-439c-b44a-898c488a6448/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 19:24:59.954463 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-52e7d4ee-d74f-4b3c-a20c-133606b5beb4 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:24:59.955192 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-52e7d4ee-d74f-4b3c-a20c-133606b5beb4 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 3097dda0-1cb7-439c-b44a-898c488a6448] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:24:59.961622 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-52e7d4ee-d74f-4b3c-a20c-133606b5beb4 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:59.962127 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-52e7d4ee-d74f-4b3c-a20c-133606b5beb4 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:59.962560 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-52e7d4ee-d74f-4b3c-a20c-133606b5beb4 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:24:59.963255 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-52e7d4ee-d74f-4b3c-a20c-133606b5beb4 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:24:59.963706 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-52e7d4ee-d74f-4b3c-a20c-133606b5beb4 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:24:59.964131 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-52e7d4ee-d74f-4b3c-a20c-133606b5beb4 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:00.004571 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-0d3183cf-31bc-4259-81cc-e05266be03a7 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b652cca4b94e188b7362606edabb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47ae1789d284a72bb71a6ffe55e7d8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:25:00.012920 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-0d3183cf-31bc-4259-81cc-e05266be03a7 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] 10.222.0.16 "GET /compute/v2.1/servers/ecd39339-b802-43f3-aba3-432fd6e5387e" status: 200 len: 1757 microversion: 2.1 time: 0.175394 Oct 31 19:25:00.013489 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 277/557] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:24:59 2022] GET /compute/v2.1/servers/ecd39339-b802-43f3-aba3-432fd6e5387e => generated 1757 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:25:00.095980 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-52e7d4ee-d74f-4b3c-a20c-133606b5beb4 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc49f9eb3114759b2889ed8972136d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cf63c76fc543428404002ae9a75b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:25:00.104502 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-52e7d4ee-d74f-4b3c-a20c-133606b5beb4 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/3097dda0-1cb7-439c-b44a-898c488a6448" status: 200 len: 1721 microversion: 2.1 time: 0.154015 Oct 31 19:25:00.105059 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 281/558] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:24:59 2022] GET /compute/v2.1/servers/3097dda0-1cb7-439c-b44a-898c488a6448 => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 19:25:00.887609 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-10d2b7fe-28a4-408e-8b24-b91d488a5e96 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:25:00.888408 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-10d2b7fe-28a4-408e-8b24-b91d488a5e96 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] [instance: 0a122a08-bc0f-40fd-8139-74c9e8a70ebe] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:25:00.895994 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-10d2b7fe-28a4-408e-8b24-b91d488a5e96 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:00.896473 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-10d2b7fe-28a4-408e-8b24-b91d488a5e96 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:00.896899 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-10d2b7fe-28a4-408e-8b24-b91d488a5e96 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:00.897589 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-10d2b7fe-28a4-408e-8b24-b91d488a5e96 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:00.898074 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-10d2b7fe-28a4-408e-8b24-b91d488a5e96 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:00.898496 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-10d2b7fe-28a4-408e-8b24-b91d488a5e96 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:00.901091 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG dbcounter [-] [118726] Writing DB stats nova_cell1:SELECT=100 {{(pid=118726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:25:01.030317 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-10d2b7fe-28a4-408e-8b24-b91d488a5e96 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ece6ca9374764214bac6263bd691bc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9c317b548b40deb8cb27236d36d674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:25:01.035718 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-4852053f-ed2b-4df2-a68e-660f53a9c065 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:25:01.036894 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-4852053f-ed2b-4df2-a68e-660f53a9c065 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] [instance: ecd39339-b802-43f3-aba3-432fd6e5387e] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:25:01.038672 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-10d2b7fe-28a4-408e-8b24-b91d488a5e96 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] 10.222.0.16 "GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe" status: 200 len: 1661 microversion: 2.1 time: 0.156038 Oct 31 19:25:01.039233 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 278/559] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:25:00 2022] GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe => generated 1661 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:25:01.043425 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-4852053f-ed2b-4df2-a68e-660f53a9c065 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:01.043900 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-4852053f-ed2b-4df2-a68e-660f53a9c065 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:01.044328 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-4852053f-ed2b-4df2-a68e-660f53a9c065 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:01.045006 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-4852053f-ed2b-4df2-a68e-660f53a9c065 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:01.045488 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-4852053f-ed2b-4df2-a68e-660f53a9c065 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:01.045959 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-4852053f-ed2b-4df2-a68e-660f53a9c065 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:01.127721 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-73823605-618b-42cf-adb8-6c65cb939833 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:25:01.128476 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-73823605-618b-42cf-adb8-6c65cb939833 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 3097dda0-1cb7-439c-b44a-898c488a6448] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:25:01.134668 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-73823605-618b-42cf-adb8-6c65cb939833 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:01.135153 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-73823605-618b-42cf-adb8-6c65cb939833 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:01.135585 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-73823605-618b-42cf-adb8-6c65cb939833 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:01.136284 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-73823605-618b-42cf-adb8-6c65cb939833 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:01.136730 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-73823605-618b-42cf-adb8-6c65cb939833 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:01.137147 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-73823605-618b-42cf-adb8-6c65cb939833 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:01.272096 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-73823605-618b-42cf-adb8-6c65cb939833 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc49f9eb3114759b2889ed8972136d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cf63c76fc543428404002ae9a75b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:25:01.280348 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-73823605-618b-42cf-adb8-6c65cb939833 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/3097dda0-1cb7-439c-b44a-898c488a6448" status: 200 len: 1721 microversion: 2.1 time: 0.156504 Oct 31 19:25:01.280922 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 279/560] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:25:01 2022] GET /compute/v2.1/servers/3097dda0-1cb7-439c-b44a-898c488a6448 => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 19:25:01.406242 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-4852053f-ed2b-4df2-a68e-660f53a9c065 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b652cca4b94e188b7362606edabb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47ae1789d284a72bb71a6ffe55e7d8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:25:01.414292 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-4852053f-ed2b-4df2-a68e-660f53a9c065 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] 10.222.0.16 "GET /compute/v2.1/servers/ecd39339-b802-43f3-aba3-432fd6e5387e" status: 200 len: 1757 microversion: 2.1 time: 0.382365 Oct 31 19:25:01.414862 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 282/561] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:25:01 2022] GET /compute/v2.1/servers/ecd39339-b802-43f3-aba3-432fd6e5387e => generated 1757 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 19:25:02.061823 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-3818ebc4-2544-4177-9086-587d59e2b39c tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:25:02.062436 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-3818ebc4-2544-4177-9086-587d59e2b39c tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] [instance: 0a122a08-bc0f-40fd-8139-74c9e8a70ebe] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:25:02.068760 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-3818ebc4-2544-4177-9086-587d59e2b39c tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:02.069240 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-3818ebc4-2544-4177-9086-587d59e2b39c tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:02.069938 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-3818ebc4-2544-4177-9086-587d59e2b39c tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:02.070642 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-3818ebc4-2544-4177-9086-587d59e2b39c tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:02.071095 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-3818ebc4-2544-4177-9086-587d59e2b39c tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:02.071552 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-3818ebc4-2544-4177-9086-587d59e2b39c tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:02.199822 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-3818ebc4-2544-4177-9086-587d59e2b39c tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ece6ca9374764214bac6263bd691bc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9c317b548b40deb8cb27236d36d674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:25:02.207320 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-3818ebc4-2544-4177-9086-587d59e2b39c tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] 10.222.0.16 "GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe" status: 200 len: 1661 microversion: 2.1 time: 0.149385 Oct 31 19:25:02.207882 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 280/562] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:25:02 2022] GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe => generated 1661 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:25:02.305387 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-c14c52ff-79ba-401c-8859-62faa8043b1c tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:25:02.306061 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-c14c52ff-79ba-401c-8859-62faa8043b1c tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 3097dda0-1cb7-439c-b44a-898c488a6448] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:25:02.312441 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-c14c52ff-79ba-401c-8859-62faa8043b1c tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:02.312868 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-c14c52ff-79ba-401c-8859-62faa8043b1c tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:02.313305 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-c14c52ff-79ba-401c-8859-62faa8043b1c tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:02.314028 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-c14c52ff-79ba-401c-8859-62faa8043b1c tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:02.314490 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-c14c52ff-79ba-401c-8859-62faa8043b1c tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:02.314918 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-c14c52ff-79ba-401c-8859-62faa8043b1c tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:02.437880 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-d15e3e58-1d82-4a1e-a38a-72ad01b3d972 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:25:02.438485 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-d15e3e58-1d82-4a1e-a38a-72ad01b3d972 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] [instance: ecd39339-b802-43f3-aba3-432fd6e5387e] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:25:02.438617 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-c14c52ff-79ba-401c-8859-62faa8043b1c tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc49f9eb3114759b2889ed8972136d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cf63c76fc543428404002ae9a75b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:25:02.444282 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-d15e3e58-1d82-4a1e-a38a-72ad01b3d972 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:02.444765 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-d15e3e58-1d82-4a1e-a38a-72ad01b3d972 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:02.445179 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-d15e3e58-1d82-4a1e-a38a-72ad01b3d972 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:02.445878 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-d15e3e58-1d82-4a1e-a38a-72ad01b3d972 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:02.446329 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-d15e3e58-1d82-4a1e-a38a-72ad01b3d972 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:02.446626 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-c14c52ff-79ba-401c-8859-62faa8043b1c tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/3097dda0-1cb7-439c-b44a-898c488a6448" status: 200 len: 1721 microversion: 2.1 time: 0.145754 Oct 31 19:25:02.446726 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-d15e3e58-1d82-4a1e-a38a-72ad01b3d972 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:02.447203 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 283/563] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:25:02 2022] GET /compute/v2.1/servers/3097dda0-1cb7-439c-b44a-898c488a6448 => generated 1721 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:25:02.590627 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-d15e3e58-1d82-4a1e-a38a-72ad01b3d972 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b652cca4b94e188b7362606edabb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47ae1789d284a72bb71a6ffe55e7d8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:25:02.599639 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-d15e3e58-1d82-4a1e-a38a-72ad01b3d972 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] 10.222.0.16 "GET /compute/v2.1/servers/ecd39339-b802-43f3-aba3-432fd6e5387e" status: 200 len: 1757 microversion: 2.1 time: 0.164830 Oct 31 19:25:02.600232 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 281/564] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:25:02 2022] GET /compute/v2.1/servers/ecd39339-b802-43f3-aba3-432fd6e5387e => generated 1757 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 19:25:03.230713 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-204939ac-af6e-49ef-a88d-dea1255bbb49 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:25:03.231340 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-204939ac-af6e-49ef-a88d-dea1255bbb49 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] [instance: 0a122a08-bc0f-40fd-8139-74c9e8a70ebe] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:25:03.237182 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-204939ac-af6e-49ef-a88d-dea1255bbb49 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:03.237706 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-204939ac-af6e-49ef-a88d-dea1255bbb49 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:03.238149 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-204939ac-af6e-49ef-a88d-dea1255bbb49 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:03.238840 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-204939ac-af6e-49ef-a88d-dea1255bbb49 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:03.239296 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-204939ac-af6e-49ef-a88d-dea1255bbb49 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:03.239723 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-204939ac-af6e-49ef-a88d-dea1255bbb49 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:03.369755 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-204939ac-af6e-49ef-a88d-dea1255bbb49 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ece6ca9374764214bac6263bd691bc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9c317b548b40deb8cb27236d36d674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:25:03.377945 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-204939ac-af6e-49ef-a88d-dea1255bbb49 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] 10.222.0.16 "GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe" status: 200 len: 1665 microversion: 2.1 time: 0.151005 Oct 31 19:25:03.378524 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 284/565] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:25:03 2022] GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe => generated 1665 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:25:03.470380 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-7df6b1e5-9c41-4175-a45e-bddda482b7c4 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:25:03.470889 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-7df6b1e5-9c41-4175-a45e-bddda482b7c4 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 3097dda0-1cb7-439c-b44a-898c488a6448] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:25:03.478151 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-7df6b1e5-9c41-4175-a45e-bddda482b7c4 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:03.479644 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-7df6b1e5-9c41-4175-a45e-bddda482b7c4 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:03.480077 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-7df6b1e5-9c41-4175-a45e-bddda482b7c4 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:03.480812 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-7df6b1e5-9c41-4175-a45e-bddda482b7c4 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:03.481311 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-7df6b1e5-9c41-4175-a45e-bddda482b7c4 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:03.481835 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-7df6b1e5-9c41-4175-a45e-bddda482b7c4 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:03.608013 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-7df6b1e5-9c41-4175-a45e-bddda482b7c4 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc49f9eb3114759b2889ed8972136d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cf63c76fc543428404002ae9a75b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:25:03.616059 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-7df6b1e5-9c41-4175-a45e-bddda482b7c4 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/3097dda0-1cb7-439c-b44a-898c488a6448" status: 200 len: 1721 microversion: 2.1 time: 0.149544 Oct 31 19:25:03.616651 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 282/566] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:25:03 2022] GET /compute/v2.1/servers/3097dda0-1cb7-439c-b44a-898c488a6448 => generated 1721 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:25:03.623098 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-568b2b2c-8856-444c-96c8-a9abb028a54e tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:25:03.623737 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-568b2b2c-8856-444c-96c8-a9abb028a54e tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] [instance: ecd39339-b802-43f3-aba3-432fd6e5387e] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:25:03.629598 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-568b2b2c-8856-444c-96c8-a9abb028a54e tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:03.630603 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-568b2b2c-8856-444c-96c8-a9abb028a54e tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:03.631052 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-568b2b2c-8856-444c-96c8-a9abb028a54e tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:03.631722 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-568b2b2c-8856-444c-96c8-a9abb028a54e tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:03.632177 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-568b2b2c-8856-444c-96c8-a9abb028a54e tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:03.632597 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-568b2b2c-8856-444c-96c8-a9abb028a54e tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:03.779930 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-568b2b2c-8856-444c-96c8-a9abb028a54e tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b652cca4b94e188b7362606edabb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47ae1789d284a72bb71a6ffe55e7d8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:25:03.788715 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-568b2b2c-8856-444c-96c8-a9abb028a54e tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] 10.222.0.16 "GET /compute/v2.1/servers/ecd39339-b802-43f3-aba3-432fd6e5387e" status: 200 len: 1757 microversion: 2.1 time: 0.169447 Oct 31 19:25:03.789472 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 285/567] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:25:03 2022] GET /compute/v2.1/servers/ecd39339-b802-43f3-aba3-432fd6e5387e => generated 1757 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:25:04.639741 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-50ba5a9d-6fdb-479f-ab30-3140e1c50ee7 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:25:04.640374 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-50ba5a9d-6fdb-479f-ab30-3140e1c50ee7 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 3097dda0-1cb7-439c-b44a-898c488a6448] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:25:04.647322 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-50ba5a9d-6fdb-479f-ab30-3140e1c50ee7 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:04.647801 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-50ba5a9d-6fdb-479f-ab30-3140e1c50ee7 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:04.648240 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-50ba5a9d-6fdb-479f-ab30-3140e1c50ee7 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:04.648919 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-50ba5a9d-6fdb-479f-ab30-3140e1c50ee7 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:04.649383 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-50ba5a9d-6fdb-479f-ab30-3140e1c50ee7 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:04.649834 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-50ba5a9d-6fdb-479f-ab30-3140e1c50ee7 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:04.776536 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-50ba5a9d-6fdb-479f-ab30-3140e1c50ee7 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc49f9eb3114759b2889ed8972136d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cf63c76fc543428404002ae9a75b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:25:04.784645 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-50ba5a9d-6fdb-479f-ab30-3140e1c50ee7 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/3097dda0-1cb7-439c-b44a-898c488a6448" status: 200 len: 1721 microversion: 2.1 time: 0.148717 Oct 31 19:25:04.785205 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 283/568] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:25:04 2022] GET /compute/v2.1/servers/3097dda0-1cb7-439c-b44a-898c488a6448 => generated 1721 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:25:04.812297 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-3e27636a-eca4-437b-ae7e-1215b6606112 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:25:04.812915 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-3e27636a-eca4-437b-ae7e-1215b6606112 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] [instance: ecd39339-b802-43f3-aba3-432fd6e5387e] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:25:04.820006 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-3e27636a-eca4-437b-ae7e-1215b6606112 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:04.820514 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-3e27636a-eca4-437b-ae7e-1215b6606112 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:04.820953 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-3e27636a-eca4-437b-ae7e-1215b6606112 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:04.821662 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-3e27636a-eca4-437b-ae7e-1215b6606112 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:04.822120 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-3e27636a-eca4-437b-ae7e-1215b6606112 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:04.822540 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-3e27636a-eca4-437b-ae7e-1215b6606112 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:04.967753 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-3e27636a-eca4-437b-ae7e-1215b6606112 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b652cca4b94e188b7362606edabb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47ae1789d284a72bb71a6ffe55e7d8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:25:04.976658 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-3e27636a-eca4-437b-ae7e-1215b6606112 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] 10.222.0.16 "GET /compute/v2.1/servers/ecd39339-b802-43f3-aba3-432fd6e5387e" status: 200 len: 1757 microversion: 2.1 time: 0.168225 Oct 31 19:25:04.977220 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 286/569] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:25:04 2022] GET /compute/v2.1/servers/ecd39339-b802-43f3-aba3-432fd6e5387e => generated 1757 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:25:05.809428 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-e60b3ed0-535d-4f82-9b77-c70f62dfb5c9 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:25:05.810067 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-e60b3ed0-535d-4f82-9b77-c70f62dfb5c9 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 3097dda0-1cb7-439c-b44a-898c488a6448] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:25:05.817020 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-e60b3ed0-535d-4f82-9b77-c70f62dfb5c9 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:05.817645 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-e60b3ed0-535d-4f82-9b77-c70f62dfb5c9 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:05.818079 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-e60b3ed0-535d-4f82-9b77-c70f62dfb5c9 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:05.818757 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-e60b3ed0-535d-4f82-9b77-c70f62dfb5c9 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:05.819207 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-e60b3ed0-535d-4f82-9b77-c70f62dfb5c9 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:05.819629 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-e60b3ed0-535d-4f82-9b77-c70f62dfb5c9 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:05.944550 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-e60b3ed0-535d-4f82-9b77-c70f62dfb5c9 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc49f9eb3114759b2889ed8972136d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cf63c76fc543428404002ae9a75b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:25:05.952650 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-e60b3ed0-535d-4f82-9b77-c70f62dfb5c9 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/3097dda0-1cb7-439c-b44a-898c488a6448" status: 200 len: 1721 microversion: 2.1 time: 0.148009 Oct 31 19:25:05.953219 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 284/570] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:25:05 2022] GET /compute/v2.1/servers/3097dda0-1cb7-439c-b44a-898c488a6448 => generated 1721 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:25:05.999738 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-17ac8589-188b-4361-b495-55b10c797028 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:25:06.000351 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-17ac8589-188b-4361-b495-55b10c797028 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] [instance: ecd39339-b802-43f3-aba3-432fd6e5387e] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:25:06.002751 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG dbcounter [-] [118727] Writing DB stats nova_api:SELECT=72 {{(pid=118727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:25:06.007950 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-17ac8589-188b-4361-b495-55b10c797028 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:06.008434 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-17ac8589-188b-4361-b495-55b10c797028 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:06.008871 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-17ac8589-188b-4361-b495-55b10c797028 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:06.009566 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-17ac8589-188b-4361-b495-55b10c797028 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:06.010045 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-17ac8589-188b-4361-b495-55b10c797028 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:06.010467 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-17ac8589-188b-4361-b495-55b10c797028 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:06.153480 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-17ac8589-188b-4361-b495-55b10c797028 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b652cca4b94e188b7362606edabb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47ae1789d284a72bb71a6ffe55e7d8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:25:06.162200 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-17ac8589-188b-4361-b495-55b10c797028 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] 10.222.0.16 "GET /compute/v2.1/servers/ecd39339-b802-43f3-aba3-432fd6e5387e" status: 200 len: 1757 microversion: 2.1 time: 0.166387 Oct 31 19:25:06.162780 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 287/571] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:25:05 2022] GET /compute/v2.1/servers/ecd39339-b802-43f3-aba3-432fd6e5387e => generated 1757 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:25:06.975868 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-3bcd8a50-602e-4383-acf8-cf367fa65506 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:25:06.976505 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-3bcd8a50-602e-4383-acf8-cf367fa65506 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 3097dda0-1cb7-439c-b44a-898c488a6448] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:25:06.982944 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-3bcd8a50-602e-4383-acf8-cf367fa65506 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:06.983464 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-3bcd8a50-602e-4383-acf8-cf367fa65506 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:06.983889 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-3bcd8a50-602e-4383-acf8-cf367fa65506 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:06.984567 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-3bcd8a50-602e-4383-acf8-cf367fa65506 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:06.985084 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-3bcd8a50-602e-4383-acf8-cf367fa65506 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:06.985470 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-3bcd8a50-602e-4383-acf8-cf367fa65506 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:07.113835 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-a55e39ba-f379-4028-9820-32e4ca38527d tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:25:07.114964 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-a55e39ba-f379-4028-9820-32e4ca38527d tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] [instance: a61dd73b-990e-4832-8528-41baab5db81a] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:25:07.115079 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-3bcd8a50-602e-4383-acf8-cf367fa65506 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc49f9eb3114759b2889ed8972136d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cf63c76fc543428404002ae9a75b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:25:07.122863 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-a55e39ba-f379-4028-9820-32e4ca38527d tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:07.123429 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-3bcd8a50-602e-4383-acf8-cf367fa65506 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/3097dda0-1cb7-439c-b44a-898c488a6448" status: 200 len: 1727 microversion: 2.1 time: 0.151516 Oct 31 19:25:07.123562 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-a55e39ba-f379-4028-9820-32e4ca38527d tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:07.124022 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-a55e39ba-f379-4028-9820-32e4ca38527d tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:07.124165 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 285/572] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:25:06 2022] GET /compute/v2.1/servers/3097dda0-1cb7-439c-b44a-898c488a6448 => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:25:07.124822 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-a55e39ba-f379-4028-9820-32e4ca38527d tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:07.125350 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-a55e39ba-f379-4028-9820-32e4ca38527d tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:07.126138 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-a55e39ba-f379-4028-9820-32e4ca38527d tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:07.146764 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-3b46b414-cf2f-48cc-9dfa-575ff3339476 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:25:07.147250 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-3b46b414-cf2f-48cc-9dfa-575ff3339476 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 3097dda0-1cb7-439c-b44a-898c488a6448] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:25:07.152948 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-3b46b414-cf2f-48cc-9dfa-575ff3339476 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:07.153431 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-3b46b414-cf2f-48cc-9dfa-575ff3339476 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:07.154113 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-3b46b414-cf2f-48cc-9dfa-575ff3339476 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:07.154804 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-3b46b414-cf2f-48cc-9dfa-575ff3339476 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:07.155437 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-3b46b414-cf2f-48cc-9dfa-575ff3339476 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:07.155879 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-3b46b414-cf2f-48cc-9dfa-575ff3339476 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:07.214889 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.objects.instance [None req-a55e39ba-f379-4028-9820-32e4ca38527d tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Lazy-loading 'services' on Instance uuid a61dd73b-990e-4832-8528-41baab5db81a {{(pid=118727) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 19:25:07.243710 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-3b46b414-cf2f-48cc-9dfa-575ff3339476 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/3097dda0-1cb7-439c-b44a-898c488a6448/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.100596 Oct 31 19:25:07.244344 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 286/573] 10.222.0.16 () {58 vars in 1275 bytes} [Mon Oct 31 19:25:07 2022] GET /compute/v2.1/servers/3097dda0-1cb7-439c-b44a-898c488a6448/os-interface => generated 284 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 19:25:07.250551 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-0e6e2769-0217-49a3-8f35-0bebe4aef024 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:25:07.251620 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-0e6e2769-0217-49a3-8f35-0bebe4aef024 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] [instance: ecd39339-b802-43f3-aba3-432fd6e5387e] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:25:07.259453 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-0e6e2769-0217-49a3-8f35-0bebe4aef024 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:07.260310 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-0e6e2769-0217-49a3-8f35-0bebe4aef024 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:07.260930 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-0e6e2769-0217-49a3-8f35-0bebe4aef024 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:07.261983 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-0e6e2769-0217-49a3-8f35-0bebe4aef024 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:07.262443 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-0e6e2769-0217-49a3-8f35-0bebe4aef024 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:07.262877 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-0e6e2769-0217-49a3-8f35-0bebe4aef024 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:07.310314 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-a55e39ba-f379-4028-9820-32e4ca38527d tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] 10.222.0.16 "DELETE /compute/v2.1/servers/a61dd73b-990e-4832-8528-41baab5db81a/os-volume_attachments/adce386f-8e33-4cb0-b70e-11ab18c8d4e0" status: 202 len: 0 microversion: 2.1 time: 0.200798 Oct 31 19:25:07.311373 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 288/574] 10.222.0.16 () {58 vars in 1416 bytes} [Mon Oct 31 19:25:07 2022] DELETE /compute/v2.1/servers/a61dd73b-990e-4832-8528-41baab5db81a/os-volume_attachments/adce386f-8e33-4cb0-b70e-11ab18c8d4e0 => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 19:25:07.424236 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-0e6e2769-0217-49a3-8f35-0bebe4aef024 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b652cca4b94e188b7362606edabb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47ae1789d284a72bb71a6ffe55e7d8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:25:07.433136 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-0e6e2769-0217-49a3-8f35-0bebe4aef024 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] 10.222.0.16 "GET /compute/v2.1/servers/ecd39339-b802-43f3-aba3-432fd6e5387e" status: 200 len: 1760 microversion: 2.1 time: 0.187524 Oct 31 19:25:07.433843 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 287/575] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:25:07 2022] GET /compute/v2.1/servers/ecd39339-b802-43f3-aba3-432fd6e5387e => generated 1760 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:25:08.163780 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [req-612a3961-30d6-47e8-8c13-8082fe7919fb req-56644a3f-dd9a-44e4-84aa-f15a87982225 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3097dda0-1cb7-439c-b44a-898c488a6448", "tag": "47bfb5db-2a8e-49bb-8942-819d0c5b71da"}]} {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:25:08.175531 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [req-612a3961-30d6-47e8-8c13-8082fe7919fb req-56644a3f-dd9a-44e4-84aa-f15a87982225 service nova] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:08.176106 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [req-612a3961-30d6-47e8-8c13-8082fe7919fb req-56644a3f-dd9a-44e4-84aa-f15a87982225 service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:08.176578 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [req-612a3961-30d6-47e8-8c13-8082fe7919fb req-56644a3f-dd9a-44e4-84aa-f15a87982225 service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:08.191125 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.compute.server_external_events [req-612a3961-30d6-47e8-8c13-8082fe7919fb req-56644a3f-dd9a-44e4-84aa-f15a87982225 service nova] Creating event network-changed:47bfb5db-2a8e-49bb-8942-819d0c5b71da for instance 3097dda0-1cb7-439c-b44a-898c488a6448 on hv-cinder-86309 Oct 31 19:25:08.198192 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [req-612a3961-30d6-47e8-8c13-8082fe7919fb req-56644a3f-dd9a-44e4-84aa-f15a87982225 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038391 Oct 31 19:25:08.198792 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 289/576] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 31 19:25:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:25:09.522321 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-37b39ca0-153a-4e78-90c7-4df373875c82 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:25:09.522844 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-37b39ca0-153a-4e78-90c7-4df373875c82 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] [instance: a61dd73b-990e-4832-8528-41baab5db81a] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:25:09.529367 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-37b39ca0-153a-4e78-90c7-4df373875c82 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:09.531234 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-37b39ca0-153a-4e78-90c7-4df373875c82 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:09.531234 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-37b39ca0-153a-4e78-90c7-4df373875c82 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:09.531234 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-37b39ca0-153a-4e78-90c7-4df373875c82 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:09.531533 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-37b39ca0-153a-4e78-90c7-4df373875c82 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:09.532255 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-37b39ca0-153a-4e78-90c7-4df373875c82 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:09.558173 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-37b39ca0-153a-4e78-90c7-4df373875c82 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] [instance: a61dd73b-990e-4832-8528-41baab5db81a] Going to try to terminate instance {{(pid=118726) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 19:25:09.633993 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-37b39ca0-153a-4e78-90c7-4df373875c82 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] 10.222.0.16 "DELETE /compute/v2.1/servers/a61dd73b-990e-4832-8528-41baab5db81a" status: 204 len: 0 microversion: 2.1 time: 0.115118 Oct 31 19:25:09.634578 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 288/577] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 31 19:25:09 2022] DELETE /compute/v2.1/servers/a61dd73b-990e-4832-8528-41baab5db81a => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 19:25:09.644074 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-899af0d7-6426-49d4-b3d3-a66f119c6dd2 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:25:09.644773 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-899af0d7-6426-49d4-b3d3-a66f119c6dd2 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] [instance: a61dd73b-990e-4832-8528-41baab5db81a] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:25:09.650820 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-899af0d7-6426-49d4-b3d3-a66f119c6dd2 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:09.651288 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-899af0d7-6426-49d4-b3d3-a66f119c6dd2 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:09.651714 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-899af0d7-6426-49d4-b3d3-a66f119c6dd2 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:09.652389 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-899af0d7-6426-49d4-b3d3-a66f119c6dd2 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:09.652834 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-899af0d7-6426-49d4-b3d3-a66f119c6dd2 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:09.653247 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-899af0d7-6426-49d4-b3d3-a66f119c6dd2 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:09.786809 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-899af0d7-6426-49d4-b3d3-a66f119c6dd2 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbeda8236874f2ca69a6638c626e466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2956107c4664ccd8a7517a707982d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:25:09.794752 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-899af0d7-6426-49d4-b3d3-a66f119c6dd2 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] 10.222.0.16 "GET /compute/v2.1/servers/a61dd73b-990e-4832-8528-41baab5db81a" status: 200 len: 1514 microversion: 2.1 time: 0.155272 Oct 31 19:25:09.795335 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 290/578] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:25:09 2022] GET /compute/v2.1/servers/a61dd73b-990e-4832-8528-41baab5db81a => generated 1514 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:25:10.213445 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [req-80d533c3-5e63-4137-b495-225f5744c746 req-2758e927-6e00-4f94-ac01-fabf4233f07e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3097dda0-1cb7-439c-b44a-898c488a6448", "tag": "47bfb5db-2a8e-49bb-8942-819d0c5b71da"}]} {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:25:10.222839 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [req-80d533c3-5e63-4137-b495-225f5744c746 req-2758e927-6e00-4f94-ac01-fabf4233f07e service nova] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:10.223956 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [req-80d533c3-5e63-4137-b495-225f5744c746 req-2758e927-6e00-4f94-ac01-fabf4233f07e service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:10.224390 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [req-80d533c3-5e63-4137-b495-225f5744c746 req-2758e927-6e00-4f94-ac01-fabf4233f07e service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:10.234904 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.compute.server_external_events [req-80d533c3-5e63-4137-b495-225f5744c746 req-2758e927-6e00-4f94-ac01-fabf4233f07e service nova] Creating event network-changed:47bfb5db-2a8e-49bb-8942-819d0c5b71da for instance 3097dda0-1cb7-439c-b44a-898c488a6448 on hv-cinder-86309 Oct 31 19:25:10.239499 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [req-80d533c3-5e63-4137-b495-225f5744c746 req-2758e927-6e00-4f94-ac01-fabf4233f07e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030053 Oct 31 19:25:10.240050 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 289/579] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 31 19:25:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:25:10.819052 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-4ba9ff01-4c08-46fe-b359-88640957895d tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:25:10.819660 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-4ba9ff01-4c08-46fe-b359-88640957895d tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] [instance: a61dd73b-990e-4832-8528-41baab5db81a] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:25:10.826109 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-4ba9ff01-4c08-46fe-b359-88640957895d tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:10.826589 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-4ba9ff01-4c08-46fe-b359-88640957895d tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:10.827021 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-4ba9ff01-4c08-46fe-b359-88640957895d tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:10.827705 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-4ba9ff01-4c08-46fe-b359-88640957895d tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:10.828157 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-4ba9ff01-4c08-46fe-b359-88640957895d tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:10.828579 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-4ba9ff01-4c08-46fe-b359-88640957895d tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:10.831203 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG dbcounter [-] [118727] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=118727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:25:10.955405 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-4ba9ff01-4c08-46fe-b359-88640957895d tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbeda8236874f2ca69a6638c626e466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2956107c4664ccd8a7517a707982d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:25:10.963040 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-4ba9ff01-4c08-46fe-b359-88640957895d tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] 10.222.0.16 "GET /compute/v2.1/servers/a61dd73b-990e-4832-8528-41baab5db81a" status: 200 len: 1514 microversion: 2.1 time: 0.148618 Oct 31 19:25:10.963598 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 291/580] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:25:10 2022] GET /compute/v2.1/servers/a61dd73b-990e-4832-8528-41baab5db81a => generated 1514 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:25:11.986632 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-5eef068f-be8d-4d13-b2e7-5d2ce9c5fc3f tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:25:11.987330 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-5eef068f-be8d-4d13-b2e7-5d2ce9c5fc3f tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] [instance: a61dd73b-990e-4832-8528-41baab5db81a] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:25:11.989277 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG dbcounter [-] [118726] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=1 {{(pid=118726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:25:11.994557 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-5eef068f-be8d-4d13-b2e7-5d2ce9c5fc3f tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:11.995031 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-5eef068f-be8d-4d13-b2e7-5d2ce9c5fc3f tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:11.995459 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-5eef068f-be8d-4d13-b2e7-5d2ce9c5fc3f tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:11.996133 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-5eef068f-be8d-4d13-b2e7-5d2ce9c5fc3f tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:11.996579 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-5eef068f-be8d-4d13-b2e7-5d2ce9c5fc3f tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:11.996994 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-5eef068f-be8d-4d13-b2e7-5d2ce9c5fc3f tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:12.134310 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-5eef068f-be8d-4d13-b2e7-5d2ce9c5fc3f tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbeda8236874f2ca69a6638c626e466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2956107c4664ccd8a7517a707982d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:25:12.142339 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-5eef068f-be8d-4d13-b2e7-5d2ce9c5fc3f tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] 10.222.0.16 "GET /compute/v2.1/servers/a61dd73b-990e-4832-8528-41baab5db81a" status: 200 len: 1514 microversion: 2.1 time: 0.160317 Oct 31 19:25:12.142923 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 290/581] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:25:11 2022] GET /compute/v2.1/servers/a61dd73b-990e-4832-8528-41baab5db81a => generated 1514 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:25:12.574199 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [req-393449c3-13fa-41c7-bb56-20cd33c50d24 req-3690e412-2deb-4d4f-999c-1e92583a3361 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a61dd73b-990e-4832-8528-41baab5db81a", "name": "network-vif-deleted", "tag": "2b55714e-6a22-4127-82d1-55a0ecf6a90f"}]} {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:25:12.586271 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [req-393449c3-13fa-41c7-bb56-20cd33c50d24 req-3690e412-2deb-4d4f-999c-1e92583a3361 service nova] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:12.586745 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [req-393449c3-13fa-41c7-bb56-20cd33c50d24 req-3690e412-2deb-4d4f-999c-1e92583a3361 service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:12.587172 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [req-393449c3-13fa-41c7-bb56-20cd33c50d24 req-3690e412-2deb-4d4f-999c-1e92583a3361 service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:12.600309 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.compute.server_external_events [req-393449c3-13fa-41c7-bb56-20cd33c50d24 req-3690e412-2deb-4d4f-999c-1e92583a3361 service nova] Creating event network-vif-deleted:2b55714e-6a22-4127-82d1-55a0ecf6a90f for instance a61dd73b-990e-4832-8528-41baab5db81a on hv-cinder-86309 Oct 31 19:25:12.607221 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [req-393449c3-13fa-41c7-bb56-20cd33c50d24 req-3690e412-2deb-4d4f-999c-1e92583a3361 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036323 Oct 31 19:25:12.607816 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 292/582] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 31 19:25:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:25:13.166899 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-d0c0a1dd-27ce-4f60-9762-82fbe3755bd5 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:25:13.167509 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-d0c0a1dd-27ce-4f60-9762-82fbe3755bd5 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] [instance: a61dd73b-990e-4832-8528-41baab5db81a] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:25:13.173845 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-d0c0a1dd-27ce-4f60-9762-82fbe3755bd5 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:13.174323 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-d0c0a1dd-27ce-4f60-9762-82fbe3755bd5 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:13.174755 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-d0c0a1dd-27ce-4f60-9762-82fbe3755bd5 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:13.175437 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-d0c0a1dd-27ce-4f60-9762-82fbe3755bd5 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:13.175888 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-d0c0a1dd-27ce-4f60-9762-82fbe3755bd5 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:13.176308 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-d0c0a1dd-27ce-4f60-9762-82fbe3755bd5 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:13.205503 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-d0c0a1dd-27ce-4f60-9762-82fbe3755bd5 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:13.206021 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-d0c0a1dd-27ce-4f60-9762-82fbe3755bd5 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:13.206449 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-d0c0a1dd-27ce-4f60-9762-82fbe3755bd5 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:13.206886 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.objects.instance [None req-d0c0a1dd-27ce-4f60-9762-82fbe3755bd5 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Lazy-loading 'fault' on Instance uuid a61dd73b-990e-4832-8528-41baab5db81a {{(pid=118726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 19:25:13.250760 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-d0c0a1dd-27ce-4f60-9762-82fbe3755bd5 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbeda8236874f2ca69a6638c626e466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2956107c4664ccd8a7517a707982d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:25:13.258246 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-d0c0a1dd-27ce-4f60-9762-82fbe3755bd5 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] 10.222.0.16 "GET /compute/v2.1/servers/a61dd73b-990e-4832-8528-41baab5db81a" status: 200 len: 1308 microversion: 2.1 time: 0.095448 Oct 31 19:25:13.258816 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 291/583] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:25:13 2022] GET /compute/v2.1/servers/a61dd73b-990e-4832-8528-41baab5db81a => generated 1308 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:25:14.281835 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-52b6f481-e1b7-4acc-9cdf-d19eff157fe3 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:25:14.282535 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-52b6f481-e1b7-4acc-9cdf-d19eff157fe3 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] [instance: a61dd73b-990e-4832-8528-41baab5db81a] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:25:14.289767 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-52b6f481-e1b7-4acc-9cdf-d19eff157fe3 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:14.290362 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-52b6f481-e1b7-4acc-9cdf-d19eff157fe3 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:14.290712 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-52b6f481-e1b7-4acc-9cdf-d19eff157fe3 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:14.291610 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-52b6f481-e1b7-4acc-9cdf-d19eff157fe3 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:14.292056 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-52b6f481-e1b7-4acc-9cdf-d19eff157fe3 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:14.292472 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-52b6f481-e1b7-4acc-9cdf-d19eff157fe3 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:14.305931 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.wsgi [None req-52b6f481-e1b7-4acc-9cdf-d19eff157fe3 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] HTTP exception thrown: Instance a61dd73b-990e-4832-8528-41baab5db81a could not be found. Oct 31 19:25:14.307507 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-52b6f481-e1b7-4acc-9cdf-d19eff157fe3 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Request method failure captured: Oct 31 19:25:14.307507 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: request: GET /compute/v2.1/servers/a61dd73b-990e-4832-8528-41baab5db81a HTTP/1.1 Oct 31 19:25:14.307507 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Accept: application/json Oct 31 19:25:14.307507 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Accept-Encoding: identity Oct 31 19:25:14.307507 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Connection: close Oct 31 19:25:14.307507 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Content-Length: 0 Oct 31 19:25:14.307507 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Content-Type: application/json Oct 31 19:25:14.307507 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Host: 10.222.0.16 Oct 31 19:25:14.307507 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Openstack-System-Scope: None Oct 31 19:25:14.307507 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: User-Agent: python-urllib3/1.26.12 Oct 31 19:25:14.307507 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Auth-Token: gAAAAABjYCDZBRm5IAtu52n2A1IC2mBLutWSQ5rRBmCcW9NmnZDh8WSMlq-t1TP-nICDvSoE-YzrYBDamZtRCrVmbWEyKJzqF2wP0d2gw7KVlgKawzN0OkwUUjO2BbjkOUh7CBDrDQufKeQag6ADsH5jSBhJDTnrWVNtxgH6pkrmE58zzRiILoU Oct 31 19:25:14.307507 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Domain-Id: None Oct 31 19:25:14.307507 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Domain-Name: None Oct 31 19:25:14.307507 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Identity-Status: Confirmed Oct 31 19:25:14.307507 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Is-Admin-Project: True Oct 31 19:25:14.307507 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Project-Domain-Id: default Oct 31 19:25:14.307507 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Project-Domain-Name: Default Oct 31 19:25:14.307507 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Project-Id: b2956107c4664ccd8a7517a707982d1b Oct 31 19:25:14.307507 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1361638688 Oct 31 19:25:14.307507 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Role: member,reader Oct 31 19:25:14.307507 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Roles: member,reader Oct 31 19:25:14.309110 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b2956107c4664ccd8a7517a707982d1b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b2956107c4664ccd8a7517a707982d1b", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b2956107c4664ccd8a7517a707982d1b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b2956107c4664ccd8a7517a707982d1b"}]}] Oct 31 19:25:14.309110 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Tenant: tempest-VolumesSnapshotTestJSON-1361638688 Oct 31 19:25:14.309110 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Tenant-Id: b2956107c4664ccd8a7517a707982d1b Oct 31 19:25:14.309110 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1361638688 Oct 31 19:25:14.309110 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User: tempest-VolumesSnapshotTestJSON-1361638688-project Oct 31 19:25:14.309110 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User-Domain-Id: default Oct 31 19:25:14.309110 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User-Domain-Name: Default Oct 31 19:25:14.309110 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User-Id: 5cbeda8236874f2ca69a6638c626e466 Oct 31 19:25:14.309110 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User-Name: tempest-VolumesSnapshotTestJSON-1361638688-project Oct 31 19:25:14.309110 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: method: > Oct 31 19:25:14.309110 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: exception: Instance a61dd73b-990e-4832-8528-41baab5db81a could not be found. Oct 31 19:25:14.309110 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: action_args: {'id': 'a61dd73b-990e-4832-8528-41baab5db81a'} Oct 31 19:25:14.310153 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 19:25:14.310153 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:25:14.310153 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 19:25:14.310153 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 19:25:14.310153 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 19:25:14.310153 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 19:25:14.310153 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 19:25:14.310153 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 19:25:14.310153 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 19:25:14.310153 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 19:25:14.310153 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a61dd73b-990e-4832-8528-41baab5db81a could not be found. Oct 31 19:25:14.310153 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:25:14.310153 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 19:25:14.310153 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:25:14.310153 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:25:14.310153 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 19:25:14.310153 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 19:25:14.310153 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 19:25:14.310153 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 19:25:14.310153 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 19:25:14.311637 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 19:25:14.311637 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 19:25:14.311637 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 19:25:14.311637 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 19:25:14.311637 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 19:25:14.311637 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 19:25:14.311637 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 19:25:14.311637 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a61dd73b-990e-4832-8528-41baab5db81a could not be found. Oct 31 19:25:14.311637 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:25:14.311637 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 19:25:14.311637 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:25:14.311637 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:25:14.311637 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 19:25:14.311637 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 19:25:14.311637 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 19:25:14.311637 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 19:25:14.311637 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a61dd73b-990e-4832-8528-41baab5db81a could not be found. Oct 31 19:25:14.311637 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:25:14.312908 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-52b6f481-e1b7-4acc-9cdf-d19eff157fe3 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Returning 404 to user: Instance a61dd73b-990e-4832-8528-41baab5db81a could not be found. {{(pid=118727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 19:25:14.312908 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-52b6f481-e1b7-4acc-9cdf-d19eff157fe3 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] 10.222.0.16 "GET /compute/v2.1/servers/a61dd73b-990e-4832-8528-41baab5db81a" status: 404 len: 111 microversion: 2.1 time: 0.031337 Oct 31 19:25:14.312908 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 293/584] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:25:14 2022] GET /compute/v2.1/servers/a61dd73b-990e-4832-8528-41baab5db81a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 19:25:17.607663 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-b77e5e59-8baa-4fe4-8c6d-0ff280d48d09 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:25:17.608192 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-b77e5e59-8baa-4fe4-8c6d-0ff280d48d09 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 24ad6e3e-6043-4eff-afb4-0c6039e825fa] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:25:17.615249 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-b77e5e59-8baa-4fe4-8c6d-0ff280d48d09 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:17.615731 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-b77e5e59-8baa-4fe4-8c6d-0ff280d48d09 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:17.616160 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-b77e5e59-8baa-4fe4-8c6d-0ff280d48d09 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:17.616843 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-b77e5e59-8baa-4fe4-8c6d-0ff280d48d09 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:17.617293 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-b77e5e59-8baa-4fe4-8c6d-0ff280d48d09 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:17.617750 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-b77e5e59-8baa-4fe4-8c6d-0ff280d48d09 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:17.646913 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-b77e5e59-8baa-4fe4-8c6d-0ff280d48d09 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa/os-volume_attachments/86dbe146-3d33-4a51-81d3-95a8ef697d59" status: 200 len: 194 microversion: 2.20 time: 0.043160 Oct 31 19:25:17.647494 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 292/585] 10.222.0.16 () {60 vars in 1454 bytes} [Mon Oct 31 19:25:17 2022] GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa/os-volume_attachments/86dbe146-3d33-4a51-81d3-95a8ef697d59 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 19:25:17.719620 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-cd9bd12d-85f9-48ba-8929-469c5077cb2b tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:25:17.720509 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-cd9bd12d-85f9-48ba-8929-469c5077cb2b tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 24ad6e3e-6043-4eff-afb4-0c6039e825fa] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:25:17.728879 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-cd9bd12d-85f9-48ba-8929-469c5077cb2b tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:17.729366 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-cd9bd12d-85f9-48ba-8929-469c5077cb2b tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:17.729839 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-cd9bd12d-85f9-48ba-8929-469c5077cb2b tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:17.730547 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-cd9bd12d-85f9-48ba-8929-469c5077cb2b tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:17.731006 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-cd9bd12d-85f9-48ba-8929-469c5077cb2b tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:17.731435 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-cd9bd12d-85f9-48ba-8929-469c5077cb2b tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:17.819758 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.objects.instance [None req-cd9bd12d-85f9-48ba-8929-469c5077cb2b tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lazy-loading 'services' on Instance uuid 24ad6e3e-6043-4eff-afb4-0c6039e825fa {{(pid=118727) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 19:25:17.890902 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-cd9bd12d-85f9-48ba-8929-469c5077cb2b tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "DELETE /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa/os-volume_attachments/86dbe146-3d33-4a51-81d3-95a8ef697d59" status: 202 len: 0 microversion: 2.20 time: 0.177157 Oct 31 19:25:17.891537 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 294/586] 10.222.0.16 () {60 vars in 1457 bytes} [Mon Oct 31 19:25:17 2022] DELETE /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa/os-volume_attachments/86dbe146-3d33-4a51-81d3-95a8ef697d59 => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 31 19:25:17.899773 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-70ea947c-1c8f-46ec-b610-e2d4dbe80bbf tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:25:17.901984 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-70ea947c-1c8f-46ec-b610-e2d4dbe80bbf tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 24ad6e3e-6043-4eff-afb4-0c6039e825fa] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:25:17.908753 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-70ea947c-1c8f-46ec-b610-e2d4dbe80bbf tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:17.909242 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-70ea947c-1c8f-46ec-b610-e2d4dbe80bbf tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:17.909897 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-70ea947c-1c8f-46ec-b610-e2d4dbe80bbf tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:17.911109 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-70ea947c-1c8f-46ec-b610-e2d4dbe80bbf tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:17.911574 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-70ea947c-1c8f-46ec-b610-e2d4dbe80bbf tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:17.912006 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-70ea947c-1c8f-46ec-b610-e2d4dbe80bbf tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:17.937436 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG dbcounter [-] [118726] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:25:17.943329 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-70ea947c-1c8f-46ec-b610-e2d4dbe80bbf tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047454 Oct 31 19:25:17.943894 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 293/587] 10.222.0.16 () {60 vars in 1343 bytes} [Mon Oct 31 19:25:17 2022] GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 19:25:18.956512 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-ea5bc25b-4a06-426a-a60f-d6a86f8130af tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:25:18.958810 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-ea5bc25b-4a06-426a-a60f-d6a86f8130af tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 24ad6e3e-6043-4eff-afb4-0c6039e825fa] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:25:18.964839 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-ea5bc25b-4a06-426a-a60f-d6a86f8130af tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:18.965321 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-ea5bc25b-4a06-426a-a60f-d6a86f8130af tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:18.965816 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-ea5bc25b-4a06-426a-a60f-d6a86f8130af tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:18.966502 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-ea5bc25b-4a06-426a-a60f-d6a86f8130af tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:18.966952 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-ea5bc25b-4a06-426a-a60f-d6a86f8130af tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:18.967373 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-ea5bc25b-4a06-426a-a60f-d6a86f8130af tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:18.997217 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-ea5bc25b-4a06-426a-a60f-d6a86f8130af tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045466 Oct 31 19:25:18.997901 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 295/588] 10.222.0.16 () {60 vars in 1343 bytes} [Mon Oct 31 19:25:18 2022] GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 19:25:19.060957 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-75e4d798-49eb-4976-8f85-4c747ab68ec4 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:25:19.061443 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-75e4d798-49eb-4976-8f85-4c747ab68ec4 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 24ad6e3e-6043-4eff-afb4-0c6039e825fa] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:25:19.070113 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-75e4d798-49eb-4976-8f85-4c747ab68ec4 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:19.070602 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-75e4d798-49eb-4976-8f85-4c747ab68ec4 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:19.071036 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-75e4d798-49eb-4976-8f85-4c747ab68ec4 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:19.071723 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-75e4d798-49eb-4976-8f85-4c747ab68ec4 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:19.072178 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-75e4d798-49eb-4976-8f85-4c747ab68ec4 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:19.072603 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-75e4d798-49eb-4976-8f85-4c747ab68ec4 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:19.099478 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-75e4d798-49eb-4976-8f85-4c747ab68ec4 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 24ad6e3e-6043-4eff-afb4-0c6039e825fa] Going to try to terminate instance {{(pid=118726) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 19:25:19.170831 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-75e4d798-49eb-4976-8f85-4c747ab68ec4 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "DELETE /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa" status: 204 len: 0 microversion: 2.20 time: 0.113344 Oct 31 19:25:19.171545 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 294/589] 10.222.0.16 () {60 vars in 1280 bytes} [Mon Oct 31 19:25:19 2022] DELETE /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 31 19:25:19.180185 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-8199cd34-4ce9-437c-95be-4437858d2343 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:25:19.180896 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-8199cd34-4ce9-437c-95be-4437858d2343 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 24ad6e3e-6043-4eff-afb4-0c6039e825fa] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:25:19.188335 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-8199cd34-4ce9-437c-95be-4437858d2343 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:19.188809 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-8199cd34-4ce9-437c-95be-4437858d2343 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:19.189244 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-8199cd34-4ce9-437c-95be-4437858d2343 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:19.189972 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-8199cd34-4ce9-437c-95be-4437858d2343 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:19.190425 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-8199cd34-4ce9-437c-95be-4437858d2343 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:19.190843 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-8199cd34-4ce9-437c-95be-4437858d2343 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:19.317098 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-8199cd34-4ce9-437c-95be-4437858d2343 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:25:19.325050 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-8199cd34-4ce9-437c-95be-4437858d2343 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:25:19.326508 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-8199cd34-4ce9-437c-95be-4437858d2343 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:25:19.327650 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-8199cd34-4ce9-437c-95be-4437858d2343 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa" status: 200 len: 1724 microversion: 2.20 time: 0.152033 Oct 31 19:25:19.328222 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 296/590] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 31 19:25:19 2022] GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 19:25:20.352954 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-8e9e7063-dd1a-41f8-bfdf-a4d6120da0d8 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:25:20.353695 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-8e9e7063-dd1a-41f8-bfdf-a4d6120da0d8 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 24ad6e3e-6043-4eff-afb4-0c6039e825fa] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:25:20.360064 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-8e9e7063-dd1a-41f8-bfdf-a4d6120da0d8 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:20.360544 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-8e9e7063-dd1a-41f8-bfdf-a4d6120da0d8 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:20.360974 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-8e9e7063-dd1a-41f8-bfdf-a4d6120da0d8 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:20.361686 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-8e9e7063-dd1a-41f8-bfdf-a4d6120da0d8 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:20.362171 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-8e9e7063-dd1a-41f8-bfdf-a4d6120da0d8 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:20.362594 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-8e9e7063-dd1a-41f8-bfdf-a4d6120da0d8 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:20.487872 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-8e9e7063-dd1a-41f8-bfdf-a4d6120da0d8 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:25:20.496537 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-8e9e7063-dd1a-41f8-bfdf-a4d6120da0d8 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:25:20.498013 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-8e9e7063-dd1a-41f8-bfdf-a4d6120da0d8 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:25:20.499183 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-8e9e7063-dd1a-41f8-bfdf-a4d6120da0d8 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa" status: 200 len: 1724 microversion: 2.20 time: 0.150642 Oct 31 19:25:20.499744 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 295/591] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 31 19:25:20 2022] GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 19:25:21.525443 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-59311cc1-748e-4634-b557-07da239eda86 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:25:21.526082 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-59311cc1-748e-4634-b557-07da239eda86 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 24ad6e3e-6043-4eff-afb4-0c6039e825fa] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:25:21.532510 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-59311cc1-748e-4634-b557-07da239eda86 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:21.533023 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-59311cc1-748e-4634-b557-07da239eda86 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:21.533460 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-59311cc1-748e-4634-b557-07da239eda86 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:21.534184 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-59311cc1-748e-4634-b557-07da239eda86 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:21.534646 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-59311cc1-748e-4634-b557-07da239eda86 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:21.535091 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-59311cc1-748e-4634-b557-07da239eda86 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:21.666826 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-59311cc1-748e-4634-b557-07da239eda86 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:25:21.674871 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-59311cc1-748e-4634-b557-07da239eda86 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:25:21.676305 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-59311cc1-748e-4634-b557-07da239eda86 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:25:21.677445 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-59311cc1-748e-4634-b557-07da239eda86 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa" status: 200 len: 1724 microversion: 2.20 time: 0.155965 Oct 31 19:25:21.678037 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 297/592] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 31 19:25:21 2022] GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 19:25:22.703088 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-8fdf75b0-c380-4291-b536-5019122caa5e tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:25:22.703691 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-8fdf75b0-c380-4291-b536-5019122caa5e tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 24ad6e3e-6043-4eff-afb4-0c6039e825fa] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:25:22.710574 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-8fdf75b0-c380-4291-b536-5019122caa5e tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:22.711049 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-8fdf75b0-c380-4291-b536-5019122caa5e tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:22.711478 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-8fdf75b0-c380-4291-b536-5019122caa5e tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:22.712155 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-8fdf75b0-c380-4291-b536-5019122caa5e tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:22.712602 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-8fdf75b0-c380-4291-b536-5019122caa5e tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:22.713020 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-8fdf75b0-c380-4291-b536-5019122caa5e tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:22.842135 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-8fdf75b0-c380-4291-b536-5019122caa5e tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:25:22.850648 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-8fdf75b0-c380-4291-b536-5019122caa5e tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:25:22.852088 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-8fdf75b0-c380-4291-b536-5019122caa5e tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:25:22.853214 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-8fdf75b0-c380-4291-b536-5019122caa5e tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa" status: 200 len: 1724 microversion: 2.20 time: 0.154041 Oct 31 19:25:22.853793 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 296/593] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 31 19:25:22 2022] GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 19:25:23.165932 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-49fa5fb6-3b83-4c29-9e22-ecdd91d7e8c8 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-351543826", "imageRef": "a9795ee0-6722-4e1e-8fc8-a6c2e68f3049", "flavorRef": "452", "networks": [{"uuid": "31f7e77e-1dcb-4684-b3e9-e4a580efbeec"}]}} {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:25:23.220826 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.network.neutron [None req-49fa5fb6-3b83-4c29-9e22-ecdd91d7e8c8 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] validate_networks() for [('31f7e77e-1dcb-4684-b3e9-e4a580efbeec', None, None, None, None, None)] {{(pid=118727) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 19:25:23.739814 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.virt.hardware [None req-49fa5fb6-3b83-4c29-9e22-ecdd91d7e8c8 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Flavor limits 0:0:0 {{(pid=118727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 19:25:23.740227 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.virt.hardware [None req-49fa5fb6-3b83-4c29-9e22-ecdd91d7e8c8 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Image limits 0:0:0 {{(pid=118727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 19:25:23.740693 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.virt.hardware [None req-49fa5fb6-3b83-4c29-9e22-ecdd91d7e8c8 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Flavor pref 0:0:0 {{(pid=118727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 19:25:23.741241 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.virt.hardware [None req-49fa5fb6-3b83-4c29-9e22-ecdd91d7e8c8 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Image pref 0:0:0 {{(pid=118727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 19:25:23.741693 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.virt.hardware [None req-49fa5fb6-3b83-4c29-9e22-ecdd91d7e8c8 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 19:25:23.750744 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-49fa5fb6-3b83-4c29-9e22-ecdd91d7e8c8 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:23.751272 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-49fa5fb6-3b83-4c29-9e22-ecdd91d7e8c8 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:23.751707 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-49fa5fb6-3b83-4c29-9e22-ecdd91d7e8c8 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:23.752424 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-49fa5fb6-3b83-4c29-9e22-ecdd91d7e8c8 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:23.752873 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-49fa5fb6-3b83-4c29-9e22-ecdd91d7e8c8 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:23.753289 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-49fa5fb6-3b83-4c29-9e22-ecdd91d7e8c8 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:23.770356 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.quota [None req-49fa5fb6-3b83-4c29-9e22-ecdd91d7e8c8 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Getting quotas for project b2956107c4664ccd8a7517a707982d1b. Resources: {'instances', 'ram', 'cores'} {{(pid=118727) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 19:25:23.774856 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.quota [None req-49fa5fb6-3b83-4c29-9e22-ecdd91d7e8c8 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Getting quotas for user 5cbeda8236874f2ca69a6638c626e466 and project b2956107c4664ccd8a7517a707982d1b. Resources: {'instances', 'ram', 'cores'} {{(pid=118727) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 19:25:23.786939 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-49fa5fb6-3b83-4c29-9e22-ecdd91d7e8c8 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Going to run 1 instances... {{(pid=118727) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 19:25:23.789216 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-49fa5fb6-3b83-4c29-9e22-ecdd91d7e8c8 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] [instance: 95bfc882-6f9e-4736-9ee4-00f63c5892ff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9795ee0-6722-4e1e-8fc8-a6c2e68f3049',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118727) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 19:25:23.837691 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-49fa5fb6-3b83-4c29-9e22-ecdd91d7e8c8 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.675455 Oct 31 19:25:23.839004 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 298/594] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 31 19:25:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 677 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 19:25:23.849856 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-d9754cd1-e61c-44bf-aed7-0cb3162b1210 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:25:23.851162 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-d9754cd1-e61c-44bf-aed7-0cb3162b1210 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] [instance: 95bfc882-6f9e-4736-9ee4-00f63c5892ff] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:25:23.880695 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-680b9e31-5750-4734-b220-078b56ecdcb7 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:25:23.881301 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-680b9e31-5750-4734-b220-078b56ecdcb7 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 24ad6e3e-6043-4eff-afb4-0c6039e825fa] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:25:23.888073 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-680b9e31-5750-4734-b220-078b56ecdcb7 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:23.888556 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-680b9e31-5750-4734-b220-078b56ecdcb7 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:23.889018 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-680b9e31-5750-4734-b220-078b56ecdcb7 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:23.889741 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-680b9e31-5750-4734-b220-078b56ecdcb7 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:23.890195 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-680b9e31-5750-4734-b220-078b56ecdcb7 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:23.890618 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-680b9e31-5750-4734-b220-078b56ecdcb7 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:23.910256 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-d9754cd1-e61c-44bf-aed7-0cb3162b1210 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbeda8236874f2ca69a6638c626e466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2956107c4664ccd8a7517a707982d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:25:23.920542 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-d9754cd1-e61c-44bf-aed7-0cb3162b1210 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] 10.222.0.16 "GET /compute/v2.1/servers/95bfc882-6f9e-4736-9ee4-00f63c5892ff" status: 200 len: 1218 microversion: 2.1 time: 0.073389 Oct 31 19:25:23.921769 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 297/595] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:25:23 2022] GET /compute/v2.1/servers/95bfc882-6f9e-4736-9ee4-00f63c5892ff => generated 1218 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 19:25:24.151980 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-680b9e31-5750-4734-b220-078b56ecdcb7 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:25:24.161295 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-680b9e31-5750-4734-b220-078b56ecdcb7 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:25:24.163012 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-680b9e31-5750-4734-b220-078b56ecdcb7 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:25:24.164341 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-680b9e31-5750-4734-b220-078b56ecdcb7 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa" status: 200 len: 1724 microversion: 2.20 time: 0.287403 Oct 31 19:25:24.170143 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 299/596] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 31 19:25:23 2022] GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa => generated 1724 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 19:25:24.574743 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [req-70adb4ae-0881-4a09-ab6d-a1eeda6d81d6 req-1496f522-94b4-42fa-9880-ec595dfec3cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24ad6e3e-6043-4eff-afb4-0c6039e825fa", "name": "network-vif-deleted", "tag": "3807af14-6f9a-4bcc-86d0-c9961d4697ae"}]} {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:25:24.591892 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [req-70adb4ae-0881-4a09-ab6d-a1eeda6d81d6 req-1496f522-94b4-42fa-9880-ec595dfec3cf service nova] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:24.592608 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [req-70adb4ae-0881-4a09-ab6d-a1eeda6d81d6 req-1496f522-94b4-42fa-9880-ec595dfec3cf service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:24.593042 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [req-70adb4ae-0881-4a09-ab6d-a1eeda6d81d6 req-1496f522-94b4-42fa-9880-ec595dfec3cf service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:24.607357 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.compute.server_external_events [req-70adb4ae-0881-4a09-ab6d-a1eeda6d81d6 req-1496f522-94b4-42fa-9880-ec595dfec3cf service nova] Creating event network-vif-deleted:3807af14-6f9a-4bcc-86d0-c9961d4697ae for instance 24ad6e3e-6043-4eff-afb4-0c6039e825fa on hv-cinder-86309 Oct 31 19:25:24.612854 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [req-70adb4ae-0881-4a09-ab6d-a1eeda6d81d6 req-1496f522-94b4-42fa-9880-ec595dfec3cf service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041897 Oct 31 19:25:24.613714 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 298/597] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 31 19:25:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:25:24.944906 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-6e0d89b9-f828-4688-8d5b-50b1e1cfb7fa tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:25:24.945666 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-6e0d89b9-f828-4688-8d5b-50b1e1cfb7fa tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] [instance: 95bfc882-6f9e-4736-9ee4-00f63c5892ff] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:25:24.951846 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-6e0d89b9-f828-4688-8d5b-50b1e1cfb7fa tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:24.952319 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-6e0d89b9-f828-4688-8d5b-50b1e1cfb7fa tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:24.952750 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-6e0d89b9-f828-4688-8d5b-50b1e1cfb7fa tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:24.953470 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-6e0d89b9-f828-4688-8d5b-50b1e1cfb7fa tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:24.953967 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-6e0d89b9-f828-4688-8d5b-50b1e1cfb7fa tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:24.954391 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-6e0d89b9-f828-4688-8d5b-50b1e1cfb7fa tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:25.021023 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-6e0d89b9-f828-4688-8d5b-50b1e1cfb7fa tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbeda8236874f2ca69a6638c626e466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2956107c4664ccd8a7517a707982d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:25:25.028833 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-6e0d89b9-f828-4688-8d5b-50b1e1cfb7fa tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] 10.222.0.16 "GET /compute/v2.1/servers/95bfc882-6f9e-4736-9ee4-00f63c5892ff" status: 200 len: 1270 microversion: 2.1 time: 0.088827 Oct 31 19:25:25.029391 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 300/598] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:25:24 2022] GET /compute/v2.1/servers/95bfc882-6f9e-4736-9ee4-00f63c5892ff => generated 1270 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:25:25.193295 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-a1e256e4-b07a-42cc-92f7-a8266dbad915 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:25:25.194605 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-a1e256e4-b07a-42cc-92f7-a8266dbad915 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 24ad6e3e-6043-4eff-afb4-0c6039e825fa] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:25:25.203230 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-a1e256e4-b07a-42cc-92f7-a8266dbad915 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:25.203738 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-a1e256e4-b07a-42cc-92f7-a8266dbad915 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:25.204726 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-a1e256e4-b07a-42cc-92f7-a8266dbad915 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:25.208223 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-a1e256e4-b07a-42cc-92f7-a8266dbad915 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:25.208692 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-a1e256e4-b07a-42cc-92f7-a8266dbad915 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:25.209157 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-a1e256e4-b07a-42cc-92f7-a8266dbad915 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:25.246052 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-a1e256e4-b07a-42cc-92f7-a8266dbad915 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:25.246781 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-a1e256e4-b07a-42cc-92f7-a8266dbad915 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:25.247397 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-a1e256e4-b07a-42cc-92f7-a8266dbad915 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:25.247996 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.objects.instance [None req-a1e256e4-b07a-42cc-92f7-a8266dbad915 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lazy-loading 'fault' on Instance uuid 24ad6e3e-6043-4eff-afb4-0c6039e825fa {{(pid=118726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 19:25:25.356332 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-a1e256e4-b07a-42cc-92f7-a8266dbad915 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:25:25.367799 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-a1e256e4-b07a-42cc-92f7-a8266dbad915 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:25:25.374390 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-a1e256e4-b07a-42cc-92f7-a8266dbad915 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:25:25.375845 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-a1e256e4-b07a-42cc-92f7-a8266dbad915 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa" status: 200 len: 1371 microversion: 2.20 time: 0.188120 Oct 31 19:25:25.376589 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 299/599] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 31 19:25:25 2022] GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa => generated 1371 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 19:25:26.052646 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-b964bd3f-08a7-423e-8e49-522572361bc0 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:25:26.053354 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-b964bd3f-08a7-423e-8e49-522572361bc0 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] [instance: 95bfc882-6f9e-4736-9ee4-00f63c5892ff] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:25:26.062196 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-b964bd3f-08a7-423e-8e49-522572361bc0 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:26.063154 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-b964bd3f-08a7-423e-8e49-522572361bc0 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:26.063748 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-b964bd3f-08a7-423e-8e49-522572361bc0 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:26.064664 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-b964bd3f-08a7-423e-8e49-522572361bc0 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:26.065402 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-b964bd3f-08a7-423e-8e49-522572361bc0 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:26.066258 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-b964bd3f-08a7-423e-8e49-522572361bc0 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:26.310570 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-b964bd3f-08a7-423e-8e49-522572361bc0 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbeda8236874f2ca69a6638c626e466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2956107c4664ccd8a7517a707982d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:25:26.318529 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-b964bd3f-08a7-423e-8e49-522572361bc0 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] 10.222.0.16 "GET /compute/v2.1/servers/95bfc882-6f9e-4736-9ee4-00f63c5892ff" status: 200 len: 1318 microversion: 2.1 time: 0.270650 Oct 31 19:25:26.319186 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 301/600] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:25:26 2022] GET /compute/v2.1/servers/95bfc882-6f9e-4736-9ee4-00f63c5892ff => generated 1318 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:25:26.404360 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-edfcf035-50f1-4a69-9d47-6b93d998f3e1 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:25:26.405629 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-edfcf035-50f1-4a69-9d47-6b93d998f3e1 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 24ad6e3e-6043-4eff-afb4-0c6039e825fa] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:25:26.413141 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-edfcf035-50f1-4a69-9d47-6b93d998f3e1 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:26.413931 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-edfcf035-50f1-4a69-9d47-6b93d998f3e1 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:26.414555 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-edfcf035-50f1-4a69-9d47-6b93d998f3e1 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:26.415250 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-edfcf035-50f1-4a69-9d47-6b93d998f3e1 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:26.415857 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-edfcf035-50f1-4a69-9d47-6b93d998f3e1 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:26.416695 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-edfcf035-50f1-4a69-9d47-6b93d998f3e1 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:26.431507 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.wsgi [None req-edfcf035-50f1-4a69-9d47-6b93d998f3e1 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] HTTP exception thrown: Instance 24ad6e3e-6043-4eff-afb4-0c6039e825fa could not be found. Oct 31 19:25:26.433181 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-edfcf035-50f1-4a69-9d47-6b93d998f3e1 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Request method failure captured: Oct 31 19:25:26.433181 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: request: GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa HTTP/1.1 Oct 31 19:25:26.433181 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: Accept: application/json Oct 31 19:25:26.433181 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: Accept-Encoding: identity Oct 31 19:25:26.433181 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: Connection: close Oct 31 19:25:26.433181 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: Content-Length: 0 Oct 31 19:25:26.433181 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: Content-Type: application/json Oct 31 19:25:26.433181 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: Host: 10.222.0.16 Oct 31 19:25:26.433181 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: Openstack-System-Scope: None Oct 31 19:25:26.433181 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: User-Agent: python-urllib3/1.26.12 Oct 31 19:25:26.433181 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Auth-Token: gAAAAABjYCAJIq6e9_SW2_V-qMTB1CWXdLQEgHamX_tNcPcsVde7myuHRMwkZjFpVtUC_Htjp6Wvjw70PhiYlINVeW2iZUvQwiOYS0SkYm9JroGPzRAKS0UOhmKgfWb4f11FSO_SKdkvUNRRVZqUq_9fz0YsFyU6dqQ-3DxHvhHc7yuBCQxwDEw Oct 31 19:25:26.433181 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Domain-Id: None Oct 31 19:25:26.433181 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Domain-Name: None Oct 31 19:25:26.433181 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Identity-Status: Confirmed Oct 31 19:25:26.433181 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Is-Admin-Project: True Oct 31 19:25:26.433181 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Openstack-Nova-Api-Version: 2.20 Oct 31 19:25:26.433181 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Project-Domain-Id: default Oct 31 19:25:26.433181 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Project-Domain-Name: Default Oct 31 19:25:26.433181 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Project-Id: 06b4e580885f431b9ccb8aa409fdd454 Oct 31 19:25:26.433181 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1845869762 Oct 31 19:25:26.433181 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Role: member,reader Oct 31 19:25:26.433181 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Roles: member,reader Oct 31 19:25:26.434853 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/06b4e580885f431b9ccb8aa409fdd454"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_06b4e580885f431b9ccb8aa409fdd454", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/06b4e580885f431b9ccb8aa409fdd454"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/06b4e580885f431b9ccb8aa409fdd454"}]}] Oct 31 19:25:26.434853 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1845869762 Oct 31 19:25:26.434853 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Tenant-Id: 06b4e580885f431b9ccb8aa409fdd454 Oct 31 19:25:26.434853 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1845869762 Oct 31 19:25:26.434853 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-User: tempest-AttachVolumeShelveTestJSON-1845869762-project Oct 31 19:25:26.434853 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-User-Domain-Id: default Oct 31 19:25:26.434853 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-User-Domain-Name: Default Oct 31 19:25:26.434853 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-User-Id: 295bd78a5b204dc2a2d70a2610c6ab3e Oct 31 19:25:26.434853 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1845869762-project Oct 31 19:25:26.434853 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: method: > Oct 31 19:25:26.434853 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: exception: Instance 24ad6e3e-6043-4eff-afb4-0c6039e825fa could not be found. Oct 31 19:25:26.434853 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: action_args: {'id': '24ad6e3e-6043-4eff-afb4-0c6039e825fa'} Oct 31 19:25:26.435767 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 19:25:26.435767 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:25:26.435767 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 19:25:26.435767 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 19:25:26.435767 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 19:25:26.435767 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 19:25:26.435767 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 19:25:26.435767 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 19:25:26.435767 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 19:25:26.435767 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 19:25:26.435767 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24ad6e3e-6043-4eff-afb4-0c6039e825fa could not be found. Oct 31 19:25:26.435767 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Oct 31 19:25:26.435767 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 19:25:26.435767 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Oct 31 19:25:26.435767 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:25:26.435767 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 19:25:26.435767 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 19:25:26.435767 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 19:25:26.435767 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 19:25:26.435767 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 19:25:26.437174 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 19:25:26.437174 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 19:25:26.437174 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 19:25:26.437174 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 19:25:26.437174 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 19:25:26.437174 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 19:25:26.437174 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 19:25:26.437174 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24ad6e3e-6043-4eff-afb4-0c6039e825fa could not be found. Oct 31 19:25:26.437174 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Oct 31 19:25:26.437174 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 19:25:26.437174 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Oct 31 19:25:26.437174 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:25:26.437174 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 19:25:26.437174 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 19:25:26.437174 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 19:25:26.437174 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 19:25:26.437174 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24ad6e3e-6043-4eff-afb4-0c6039e825fa could not be found. Oct 31 19:25:26.437174 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Oct 31 19:25:26.439803 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-edfcf035-50f1-4a69-9d47-6b93d998f3e1 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Returning 404 to user: Instance 24ad6e3e-6043-4eff-afb4-0c6039e825fa could not be found. {{(pid=118726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 19:25:26.439803 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-edfcf035-50f1-4a69-9d47-6b93d998f3e1 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa" status: 404 len: 111 microversion: 2.20 time: 0.034168 Oct 31 19:25:26.443667 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-390478d4-912a-445c-953a-e728d2ee7254 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '.version_select at 0x7f34f1fbf700>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:25:26.448380 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 300/601] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 31 19:25:26 2022] GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 31 19:25:26.465464 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-390478d4-912a-445c-953a-e728d2ee7254 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1084722088" status: 204 len: 0 microversion: 2.20 time: 0.025547 Oct 31 19:25:26.466343 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 302/602] 10.222.0.16 () {60 vars in 1262 bytes} [Mon Oct 31 19:25:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1084722088 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 31 19:25:26.777769 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [req-e1427015-a696-4c2d-95ff-06b8d62d207c req-e87e2c75-8dba-4b19-8a9d-9bb9bd12030a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95bfc882-6f9e-4736-9ee4-00f63c5892ff", "tag": "893175ba-959f-42bd-a1b8-f25e42226117"}]} {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:25:26.788440 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [req-e1427015-a696-4c2d-95ff-06b8d62d207c req-e87e2c75-8dba-4b19-8a9d-9bb9bd12030a service nova] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:26.791493 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [req-e1427015-a696-4c2d-95ff-06b8d62d207c req-e87e2c75-8dba-4b19-8a9d-9bb9bd12030a service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:26.792165 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [req-e1427015-a696-4c2d-95ff-06b8d62d207c req-e87e2c75-8dba-4b19-8a9d-9bb9bd12030a service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:26.813847 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.compute.server_external_events [req-e1427015-a696-4c2d-95ff-06b8d62d207c req-e87e2c75-8dba-4b19-8a9d-9bb9bd12030a service nova] Creating event network-changed:893175ba-959f-42bd-a1b8-f25e42226117 for instance 95bfc882-6f9e-4736-9ee4-00f63c5892ff on hv-cinder-86309 Oct 31 19:25:26.819868 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [req-e1427015-a696-4c2d-95ff-06b8d62d207c req-e87e2c75-8dba-4b19-8a9d-9bb9bd12030a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048134 Oct 31 19:25:26.821069 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 301/603] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 31 19:25:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 19:25:27.165695 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-61276e7b-96a3-40ea-83c1-363fcb71d1b0 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Action: 'create', calling method: .version_select at 0x7f34f1fd3040>, body: {"keypair": {"name": "tempest-keypair-1720043642", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIjhnHSLFDVr7EwV0V7LmOl1/hOi/ClnZoF5hMnYmMbSGISgmBzekuK6l6yEpBOqHbl4PN1XPwU+12ExVaTgDQfG9K5O67LPagOdS9q7/tjZXFQVYC6IZ1jMQYdLoq8dMA=="}} {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:25:27.183691 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.quota [None req-61276e7b-96a3-40ea-83c1-363fcb71d1b0 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Getting quotas for project 06b4e580885f431b9ccb8aa409fdd454. Resources: {'key_pairs'} {{(pid=118727) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 19:25:27.187939 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.quota [None req-61276e7b-96a3-40ea-83c1-363fcb71d1b0 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Getting quotas for user 295bd78a5b204dc2a2d70a2610c6ab3e and project 06b4e580885f431b9ccb8aa409fdd454. Resources: {'key_pairs'} {{(pid=118727) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 19:25:27.214649 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-61276e7b-96a3-40ea-83c1-363fcb71d1b0 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.053348 Oct 31 19:25:27.215244 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 303/604] 10.222.0.16 () {62 vars in 1200 bytes} [Mon Oct 31 19:25:27 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 55 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 31 19:25:27.341921 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-4f98c4b7-a087-49e1-93c0-d2f682d365c9 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:25:27.342671 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-4f98c4b7-a087-49e1-93c0-d2f682d365c9 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] [instance: 95bfc882-6f9e-4736-9ee4-00f63c5892ff] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:25:27.349040 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-4f98c4b7-a087-49e1-93c0-d2f682d365c9 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:27.349532 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-4f98c4b7-a087-49e1-93c0-d2f682d365c9 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:27.350004 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-4f98c4b7-a087-49e1-93c0-d2f682d365c9 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:27.350697 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-4f98c4b7-a087-49e1-93c0-d2f682d365c9 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:27.351141 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-4f98c4b7-a087-49e1-93c0-d2f682d365c9 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:27.351559 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-4f98c4b7-a087-49e1-93c0-d2f682d365c9 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:27.539898 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-4f98c4b7-a087-49e1-93c0-d2f682d365c9 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbeda8236874f2ca69a6638c626e466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2956107c4664ccd8a7517a707982d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:25:27.551713 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-4f98c4b7-a087-49e1-93c0-d2f682d365c9 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] 10.222.0.16 "GET /compute/v2.1/servers/95bfc882-6f9e-4736-9ee4-00f63c5892ff" status: 200 len: 1318 microversion: 2.1 time: 0.213425 Oct 31 19:25:27.552511 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 302/605] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:25:27 2022] GET /compute/v2.1/servers/95bfc882-6f9e-4736-9ee4-00f63c5892ff => generated 1318 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:25:28.477731 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-b3bb6eab-7a01-4017-bff9-0070b2a7e413 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1449761464", "imageRef": "a9795ee0-6722-4e1e-8fc8-a6c2e68f3049", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fc617f6e-5991-4f0c-a83c-e8b4b519bfd4"}], "security_groups": [{"name": "tempest-securitygroup--1263582338"}], "key_name": "tempest-keypair-1720043642", "user_data": "}} {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:25:28.574427 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-aeefc45f-c644-4aab-a961-412a86b2c523 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:25:28.575045 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-aeefc45f-c644-4aab-a961-412a86b2c523 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] [instance: 95bfc882-6f9e-4736-9ee4-00f63c5892ff] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:25:28.581762 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-aeefc45f-c644-4aab-a961-412a86b2c523 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:28.582291 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-aeefc45f-c644-4aab-a961-412a86b2c523 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:28.582724 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-aeefc45f-c644-4aab-a961-412a86b2c523 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:28.583423 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-aeefc45f-c644-4aab-a961-412a86b2c523 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:28.583879 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-aeefc45f-c644-4aab-a961-412a86b2c523 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:28.584375 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-aeefc45f-c644-4aab-a961-412a86b2c523 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:28.719587 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-aeefc45f-c644-4aab-a961-412a86b2c523 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbeda8236874f2ca69a6638c626e466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2956107c4664ccd8a7517a707982d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:25:28.728467 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-aeefc45f-c644-4aab-a961-412a86b2c523 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] 10.222.0.16 "GET /compute/v2.1/servers/95bfc882-6f9e-4736-9ee4-00f63c5892ff" status: 200 len: 1318 microversion: 2.1 time: 0.157825 Oct 31 19:25:28.729047 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 303/606] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:25:28 2022] GET /compute/v2.1/servers/95bfc882-6f9e-4736-9ee4-00f63c5892ff => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 19:25:28.846575 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.network.neutron [None req-b3bb6eab-7a01-4017-bff9-0070b2a7e413 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] validate_networks() for [('fc617f6e-5991-4f0c-a83c-e8b4b519bfd4', None, None, None, None, None)] {{(pid=118727) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 19:25:29.372380 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.virt.hardware [None req-b3bb6eab-7a01-4017-bff9-0070b2a7e413 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Flavor limits 0:0:0 {{(pid=118727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 19:25:29.372798 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.virt.hardware [None req-b3bb6eab-7a01-4017-bff9-0070b2a7e413 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Image limits 0:0:0 {{(pid=118727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 19:25:29.373332 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.virt.hardware [None req-b3bb6eab-7a01-4017-bff9-0070b2a7e413 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Flavor pref 0:0:0 {{(pid=118727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 19:25:29.373765 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.virt.hardware [None req-b3bb6eab-7a01-4017-bff9-0070b2a7e413 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Image pref 0:0:0 {{(pid=118727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 19:25:29.374170 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.virt.hardware [None req-b3bb6eab-7a01-4017-bff9-0070b2a7e413 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 19:25:29.383279 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-b3bb6eab-7a01-4017-bff9-0070b2a7e413 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:29.383783 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-b3bb6eab-7a01-4017-bff9-0070b2a7e413 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:29.384216 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-b3bb6eab-7a01-4017-bff9-0070b2a7e413 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:29.384968 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-b3bb6eab-7a01-4017-bff9-0070b2a7e413 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:29.385420 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-b3bb6eab-7a01-4017-bff9-0070b2a7e413 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:29.385868 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-b3bb6eab-7a01-4017-bff9-0070b2a7e413 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:29.402643 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.quota [None req-b3bb6eab-7a01-4017-bff9-0070b2a7e413 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Getting quotas for project 06b4e580885f431b9ccb8aa409fdd454. Resources: {'instances', 'ram', 'cores'} {{(pid=118727) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 19:25:29.406368 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.quota [None req-b3bb6eab-7a01-4017-bff9-0070b2a7e413 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Getting quotas for user 295bd78a5b204dc2a2d70a2610c6ab3e and project 06b4e580885f431b9ccb8aa409fdd454. Resources: {'instances', 'ram', 'cores'} {{(pid=118727) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 19:25:29.417241 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-b3bb6eab-7a01-4017-bff9-0070b2a7e413 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Going to run 1 instances... {{(pid=118727) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 19:25:29.419416 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-b3bb6eab-7a01-4017-bff9-0070b2a7e413 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9795ee0-6722-4e1e-8fc8-a6c2e68f3049',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118727) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 19:25:29.464880 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-b3bb6eab-7a01-4017-bff9-0070b2a7e413 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.992640 Oct 31 19:25:29.465455 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 304/607] 10.222.0.16 () {62 vars in 1188 bytes} [Mon Oct 31 19:25:28 2022] POST /compute/v2.1/servers => generated 402 bytes in 994 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 31 19:25:29.476496 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-1aec4535-1a6a-4dd0-994c-61abd5a4ba72 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:25:29.477093 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-1aec4535-1a6a-4dd0-994c-61abd5a4ba72 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:25:29.533371 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-1aec4535-1a6a-4dd0-994c-61abd5a4ba72 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:25:29.540686 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-1aec4535-1a6a-4dd0-994c-61abd5a4ba72 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:25:29.542416 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-1aec4535-1a6a-4dd0-994c-61abd5a4ba72 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:25:29.543498 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-1aec4535-1a6a-4dd0-994c-61abd5a4ba72 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29" status: 200 len: 1282 microversion: 2.20 time: 0.070998 Oct 31 19:25:29.544049 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 304/608] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 31 19:25:29 2022] GET /compute/v2.1/servers/3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29 => generated 1282 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 19:25:29.751154 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-67230fd5-a832-438f-9748-767871bb0417 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:25:29.751753 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-67230fd5-a832-438f-9748-767871bb0417 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] [instance: 95bfc882-6f9e-4736-9ee4-00f63c5892ff] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:25:29.760640 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-67230fd5-a832-438f-9748-767871bb0417 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:29.761131 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-67230fd5-a832-438f-9748-767871bb0417 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:29.761572 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-67230fd5-a832-438f-9748-767871bb0417 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:29.762290 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-67230fd5-a832-438f-9748-767871bb0417 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:29.762746 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-67230fd5-a832-438f-9748-767871bb0417 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:29.763171 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-67230fd5-a832-438f-9748-767871bb0417 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:29.901276 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-67230fd5-a832-438f-9748-767871bb0417 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbeda8236874f2ca69a6638c626e466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2956107c4664ccd8a7517a707982d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:25:29.909817 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-67230fd5-a832-438f-9748-767871bb0417 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] 10.222.0.16 "GET /compute/v2.1/servers/95bfc882-6f9e-4736-9ee4-00f63c5892ff" status: 200 len: 1318 microversion: 2.1 time: 0.162892 Oct 31 19:25:29.910900 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 305/609] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:25:29 2022] GET /compute/v2.1/servers/95bfc882-6f9e-4736-9ee4-00f63c5892ff => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:25:30.568743 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-07893475-d025-447a-87a0-73116d467c5d tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:25:30.569354 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-07893475-d025-447a-87a0-73116d467c5d tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:25:30.575911 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-07893475-d025-447a-87a0-73116d467c5d tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:30.576392 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-07893475-d025-447a-87a0-73116d467c5d tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:30.576858 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-07893475-d025-447a-87a0-73116d467c5d tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:30.577601 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-07893475-d025-447a-87a0-73116d467c5d tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:30.578125 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-07893475-d025-447a-87a0-73116d467c5d tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:30.578547 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-07893475-d025-447a-87a0-73116d467c5d tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:30.639820 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-07893475-d025-447a-87a0-73116d467c5d tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:25:30.648523 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-07893475-d025-447a-87a0-73116d467c5d tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:25:30.650018 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-07893475-d025-447a-87a0-73116d467c5d tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:25:30.651114 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-07893475-d025-447a-87a0-73116d467c5d tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29" status: 200 len: 1334 microversion: 2.20 time: 0.086807 Oct 31 19:25:30.651658 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 305/610] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 31 19:25:30 2022] GET /compute/v2.1/servers/3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29 => generated 1334 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 19:25:30.934542 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-08ed1bd3-01ee-47fa-83ab-297793d71f9b tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:25:30.935154 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-08ed1bd3-01ee-47fa-83ab-297793d71f9b tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] [instance: 95bfc882-6f9e-4736-9ee4-00f63c5892ff] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:25:30.941497 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-08ed1bd3-01ee-47fa-83ab-297793d71f9b tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:30.942061 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-08ed1bd3-01ee-47fa-83ab-297793d71f9b tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:30.943154 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-08ed1bd3-01ee-47fa-83ab-297793d71f9b tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:30.943841 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-08ed1bd3-01ee-47fa-83ab-297793d71f9b tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:30.944290 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-08ed1bd3-01ee-47fa-83ab-297793d71f9b tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:30.944705 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-08ed1bd3-01ee-47fa-83ab-297793d71f9b tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:31.124078 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-08ed1bd3-01ee-47fa-83ab-297793d71f9b tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbeda8236874f2ca69a6638c626e466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2956107c4664ccd8a7517a707982d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:25:31.132398 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-08ed1bd3-01ee-47fa-83ab-297793d71f9b tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] 10.222.0.16 "GET /compute/v2.1/servers/95bfc882-6f9e-4736-9ee4-00f63c5892ff" status: 200 len: 1318 microversion: 2.1 time: 0.202556 Oct 31 19:25:31.133199 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 306/611] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:25:30 2022] GET /compute/v2.1/servers/95bfc882-6f9e-4736-9ee4-00f63c5892ff => generated 1318 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:25:31.677467 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-2f441a2d-b0ac-485c-bd7f-a4a7b973239e tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:25:31.678434 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-2f441a2d-b0ac-485c-bd7f-a4a7b973239e tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:25:31.684738 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-2f441a2d-b0ac-485c-bd7f-a4a7b973239e tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:31.685307 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-2f441a2d-b0ac-485c-bd7f-a4a7b973239e tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:31.685846 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-2f441a2d-b0ac-485c-bd7f-a4a7b973239e tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:31.686596 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-2f441a2d-b0ac-485c-bd7f-a4a7b973239e tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:31.687115 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-2f441a2d-b0ac-485c-bd7f-a4a7b973239e tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:31.687601 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-2f441a2d-b0ac-485c-bd7f-a4a7b973239e tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:31.825418 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-2f441a2d-b0ac-485c-bd7f-a4a7b973239e tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:25:31.833980 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-2f441a2d-b0ac-485c-bd7f-a4a7b973239e tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:25:31.835412 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-2f441a2d-b0ac-485c-bd7f-a4a7b973239e tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:25:31.836506 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-2f441a2d-b0ac-485c-bd7f-a4a7b973239e tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29" status: 200 len: 1408 microversion: 2.20 time: 0.163685 Oct 31 19:25:31.837054 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 306/612] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 31 19:25:31 2022] GET /compute/v2.1/servers/3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29 => generated 1408 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 19:25:32.110442 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [req-d573cbd7-43bb-4707-b128-e2f3e1c7535e req-d3a1ac7c-33c0-4d8c-932d-4da250333f13 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29", "tag": "0e51264f-300d-49b6-9f03-c22ed061b801"}]} {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:25:32.121444 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [req-d573cbd7-43bb-4707-b128-e2f3e1c7535e req-d3a1ac7c-33c0-4d8c-932d-4da250333f13 service nova] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:32.121962 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [req-d573cbd7-43bb-4707-b128-e2f3e1c7535e req-d3a1ac7c-33c0-4d8c-932d-4da250333f13 service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:32.122393 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [req-d573cbd7-43bb-4707-b128-e2f3e1c7535e req-d3a1ac7c-33c0-4d8c-932d-4da250333f13 service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:32.134498 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.compute.server_external_events [req-d573cbd7-43bb-4707-b128-e2f3e1c7535e req-d3a1ac7c-33c0-4d8c-932d-4da250333f13 service nova] Creating event network-changed:0e51264f-300d-49b6-9f03-c22ed061b801 for instance 3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29 on hv-cinder-86309 Oct 31 19:25:32.139469 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [req-d573cbd7-43bb-4707-b128-e2f3e1c7535e req-d3a1ac7c-33c0-4d8c-932d-4da250333f13 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033231 Oct 31 19:25:32.140104 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 307/613] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 31 19:25:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:25:32.155199 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-75d8c852-087d-46d1-82f1-fbc2971ed8c9 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:25:32.155802 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-75d8c852-087d-46d1-82f1-fbc2971ed8c9 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] [instance: 95bfc882-6f9e-4736-9ee4-00f63c5892ff] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:25:32.161862 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-75d8c852-087d-46d1-82f1-fbc2971ed8c9 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:32.162351 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-75d8c852-087d-46d1-82f1-fbc2971ed8c9 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:32.162798 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-75d8c852-087d-46d1-82f1-fbc2971ed8c9 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:32.163479 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-75d8c852-087d-46d1-82f1-fbc2971ed8c9 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:32.163930 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-75d8c852-087d-46d1-82f1-fbc2971ed8c9 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:32.164348 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-75d8c852-087d-46d1-82f1-fbc2971ed8c9 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:32.303441 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-75d8c852-087d-46d1-82f1-fbc2971ed8c9 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbeda8236874f2ca69a6638c626e466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2956107c4664ccd8a7517a707982d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:25:32.316499 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-75d8c852-087d-46d1-82f1-fbc2971ed8c9 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] 10.222.0.16 "GET /compute/v2.1/servers/95bfc882-6f9e-4736-9ee4-00f63c5892ff" status: 200 len: 1318 microversion: 2.1 time: 0.165174 Oct 31 19:25:32.317688 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 307/614] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:25:32 2022] GET /compute/v2.1/servers/95bfc882-6f9e-4736-9ee4-00f63c5892ff => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:25:32.350974 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [req-2869ffd7-cac3-46f1-b545-9ec82c4e0f75 req-fe844475-95a5-47c5-852e-f81e3423e54e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95bfc882-6f9e-4736-9ee4-00f63c5892ff", "name": "network-vif-plugged", "status": "completed", "tag": "893175ba-959f-42bd-a1b8-f25e42226117"}]} {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:25:32.363558 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [req-2869ffd7-cac3-46f1-b545-9ec82c4e0f75 req-fe844475-95a5-47c5-852e-f81e3423e54e service nova] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:32.364071 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [req-2869ffd7-cac3-46f1-b545-9ec82c4e0f75 req-fe844475-95a5-47c5-852e-f81e3423e54e service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:32.364570 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [req-2869ffd7-cac3-46f1-b545-9ec82c4e0f75 req-fe844475-95a5-47c5-852e-f81e3423e54e service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:32.375793 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.compute.server_external_events [req-2869ffd7-cac3-46f1-b545-9ec82c4e0f75 req-fe844475-95a5-47c5-852e-f81e3423e54e service nova] Creating event network-vif-plugged:893175ba-959f-42bd-a1b8-f25e42226117 for instance 95bfc882-6f9e-4736-9ee4-00f63c5892ff on hv-cinder-86309 Oct 31 19:25:32.381904 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [req-2869ffd7-cac3-46f1-b545-9ec82c4e0f75 req-fe844475-95a5-47c5-852e-f81e3423e54e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036484 Oct 31 19:25:32.382767 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 308/615] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 31 19:25:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:25:32.861986 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-f701a722-40c5-42e1-a8e3-420a78d0adc4 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:25:32.862599 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-f701a722-40c5-42e1-a8e3-420a78d0adc4 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:25:32.869529 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-f701a722-40c5-42e1-a8e3-420a78d0adc4 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:32.870039 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-f701a722-40c5-42e1-a8e3-420a78d0adc4 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:32.870471 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-f701a722-40c5-42e1-a8e3-420a78d0adc4 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:32.871154 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-f701a722-40c5-42e1-a8e3-420a78d0adc4 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:32.871605 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-f701a722-40c5-42e1-a8e3-420a78d0adc4 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:32.872026 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-f701a722-40c5-42e1-a8e3-420a78d0adc4 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:32.997917 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-f701a722-40c5-42e1-a8e3-420a78d0adc4 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:25:33.005902 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-f701a722-40c5-42e1-a8e3-420a78d0adc4 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:25:33.007351 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-f701a722-40c5-42e1-a8e3-420a78d0adc4 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:25:33.008439 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-f701a722-40c5-42e1-a8e3-420a78d0adc4 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29" status: 200 len: 1408 microversion: 2.20 time: 0.150493 Oct 31 19:25:33.009001 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 308/616] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 31 19:25:32 2022] GET /compute/v2.1/servers/3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29 => generated 1408 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 19:25:33.340386 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-59ee4513-5cdc-42b7-b971-02be001ec3e4 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:25:33.341081 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-59ee4513-5cdc-42b7-b971-02be001ec3e4 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] [instance: 95bfc882-6f9e-4736-9ee4-00f63c5892ff] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:25:33.347686 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-59ee4513-5cdc-42b7-b971-02be001ec3e4 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:33.348160 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-59ee4513-5cdc-42b7-b971-02be001ec3e4 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:33.349262 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-59ee4513-5cdc-42b7-b971-02be001ec3e4 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:33.349978 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-59ee4513-5cdc-42b7-b971-02be001ec3e4 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:33.350458 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-59ee4513-5cdc-42b7-b971-02be001ec3e4 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:33.350877 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-59ee4513-5cdc-42b7-b971-02be001ec3e4 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:33.482159 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-59ee4513-5cdc-42b7-b971-02be001ec3e4 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbeda8236874f2ca69a6638c626e466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2956107c4664ccd8a7517a707982d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:25:33.489784 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-59ee4513-5cdc-42b7-b971-02be001ec3e4 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] 10.222.0.16 "GET /compute/v2.1/servers/95bfc882-6f9e-4736-9ee4-00f63c5892ff" status: 200 len: 1318 microversion: 2.1 time: 0.153575 Oct 31 19:25:33.490340 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 309/617] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:25:33 2022] GET /compute/v2.1/servers/95bfc882-6f9e-4736-9ee4-00f63c5892ff => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:25:34.032381 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-8fc99d40-3f34-44c5-9f30-e644c64cc7be tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:25:34.033006 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-8fc99d40-3f34-44c5-9f30-e644c64cc7be tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:25:34.039331 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-8fc99d40-3f34-44c5-9f30-e644c64cc7be tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:34.039818 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-8fc99d40-3f34-44c5-9f30-e644c64cc7be tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:34.040249 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-8fc99d40-3f34-44c5-9f30-e644c64cc7be tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:34.040941 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-8fc99d40-3f34-44c5-9f30-e644c64cc7be tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:34.041676 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-8fc99d40-3f34-44c5-9f30-e644c64cc7be tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:34.042101 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-8fc99d40-3f34-44c5-9f30-e644c64cc7be tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:34.167711 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-8fc99d40-3f34-44c5-9f30-e644c64cc7be tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:25:34.175920 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-8fc99d40-3f34-44c5-9f30-e644c64cc7be tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:25:34.177892 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-8fc99d40-3f34-44c5-9f30-e644c64cc7be tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:25:34.178975 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-8fc99d40-3f34-44c5-9f30-e644c64cc7be tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29" status: 200 len: 1408 microversion: 2.20 time: 0.150565 Oct 31 19:25:34.179537 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 309/618] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 31 19:25:34 2022] GET /compute/v2.1/servers/3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29 => generated 1408 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 19:25:34.512110 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-d777e3dc-0ec4-4bb9-8c7a-668d60ddb2dd tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:25:34.512653 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-d777e3dc-0ec4-4bb9-8c7a-668d60ddb2dd tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] [instance: 95bfc882-6f9e-4736-9ee4-00f63c5892ff] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:25:34.518955 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-d777e3dc-0ec4-4bb9-8c7a-668d60ddb2dd tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:34.519431 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-d777e3dc-0ec4-4bb9-8c7a-668d60ddb2dd tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:34.519861 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-d777e3dc-0ec4-4bb9-8c7a-668d60ddb2dd tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:34.520541 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-d777e3dc-0ec4-4bb9-8c7a-668d60ddb2dd tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:34.521024 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-d777e3dc-0ec4-4bb9-8c7a-668d60ddb2dd tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:34.521443 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-d777e3dc-0ec4-4bb9-8c7a-668d60ddb2dd tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:34.717632 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-d777e3dc-0ec4-4bb9-8c7a-668d60ddb2dd tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbeda8236874f2ca69a6638c626e466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2956107c4664ccd8a7517a707982d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:25:34.725796 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-d777e3dc-0ec4-4bb9-8c7a-668d60ddb2dd tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] 10.222.0.16 "GET /compute/v2.1/servers/95bfc882-6f9e-4736-9ee4-00f63c5892ff" status: 200 len: 1318 microversion: 2.1 time: 0.217697 Oct 31 19:25:34.726361 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 310/619] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:25:34 2022] GET /compute/v2.1/servers/95bfc882-6f9e-4736-9ee4-00f63c5892ff => generated 1318 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:25:35.203969 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-95493ac4-5d22-4e21-9024-be000ed96938 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:25:35.204573 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-95493ac4-5d22-4e21-9024-be000ed96938 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:25:35.211857 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-95493ac4-5d22-4e21-9024-be000ed96938 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:35.212334 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-95493ac4-5d22-4e21-9024-be000ed96938 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:35.212762 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-95493ac4-5d22-4e21-9024-be000ed96938 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:35.213451 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-95493ac4-5d22-4e21-9024-be000ed96938 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:35.213938 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-95493ac4-5d22-4e21-9024-be000ed96938 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:35.214364 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-95493ac4-5d22-4e21-9024-be000ed96938 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:35.343746 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-95493ac4-5d22-4e21-9024-be000ed96938 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:25:35.352217 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-95493ac4-5d22-4e21-9024-be000ed96938 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:25:35.353729 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-95493ac4-5d22-4e21-9024-be000ed96938 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:25:35.354819 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-95493ac4-5d22-4e21-9024-be000ed96938 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29" status: 200 len: 1408 microversion: 2.20 time: 0.154716 Oct 31 19:25:35.355404 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 310/620] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 31 19:25:35 2022] GET /compute/v2.1/servers/3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29 => generated 1408 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 19:25:35.748021 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-85086efa-f357-4503-a771-b78e509e4f0b tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:25:35.748629 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-85086efa-f357-4503-a771-b78e509e4f0b tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] [instance: 95bfc882-6f9e-4736-9ee4-00f63c5892ff] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:25:35.755620 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-85086efa-f357-4503-a771-b78e509e4f0b tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:35.756094 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-85086efa-f357-4503-a771-b78e509e4f0b tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:35.756522 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-85086efa-f357-4503-a771-b78e509e4f0b tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:35.757205 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-85086efa-f357-4503-a771-b78e509e4f0b tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:35.757674 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-85086efa-f357-4503-a771-b78e509e4f0b tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:35.758093 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-85086efa-f357-4503-a771-b78e509e4f0b tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:35.988291 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-85086efa-f357-4503-a771-b78e509e4f0b tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbeda8236874f2ca69a6638c626e466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2956107c4664ccd8a7517a707982d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:25:35.996402 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-85086efa-f357-4503-a771-b78e509e4f0b tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] 10.222.0.16 "GET /compute/v2.1/servers/95bfc882-6f9e-4736-9ee4-00f63c5892ff" status: 200 len: 1507 microversion: 2.1 time: 0.252213 Oct 31 19:25:35.996964 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 311/621] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:25:35 2022] GET /compute/v2.1/servers/95bfc882-6f9e-4736-9ee4-00f63c5892ff => generated 1507 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:25:36.018092 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-c102385b-d68a-4863-a81d-aa33234af237 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5f393cdb-f88b-4045-81c5-627809da8680", "device": "/dev/sdb"}} {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:25:36.020443 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-c102385b-d68a-4863-a81d-aa33234af237 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] [instance: 95bfc882-6f9e-4736-9ee4-00f63c5892ff] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:25:36.026351 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-c102385b-d68a-4863-a81d-aa33234af237 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:36.026833 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-c102385b-d68a-4863-a81d-aa33234af237 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:36.027265 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-c102385b-d68a-4863-a81d-aa33234af237 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:36.027952 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-c102385b-d68a-4863-a81d-aa33234af237 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:36.028403 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-c102385b-d68a-4863-a81d-aa33234af237 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:36.028825 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-c102385b-d68a-4863-a81d-aa33234af237 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:36.162999 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG dbcounter [-] [118726] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:25:36.275097 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-c102385b-d68a-4863-a81d-aa33234af237 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] 10.222.0.16 "POST /compute/v2.1/servers/95bfc882-6f9e-4736-9ee4-00f63c5892ff/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.260786 Oct 31 19:25:36.276006 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 311/622] 10.222.0.16 () {60 vars in 1323 bytes} [Mon Oct 31 19:25:36 2022] POST /compute/v2.1/servers/95bfc882-6f9e-4736-9ee4-00f63c5892ff/os-volume_attachments => generated 194 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:25:36.380238 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-a0355ed6-84c2-4b84-9c64-e7a0bc357a0d tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:25:36.380927 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-a0355ed6-84c2-4b84-9c64-e7a0bc357a0d tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:25:36.383003 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG dbcounter [-] [118727] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=7,nova_api:DELETE=1 {{(pid=118727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:25:36.388543 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-a0355ed6-84c2-4b84-9c64-e7a0bc357a0d tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:36.389032 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-a0355ed6-84c2-4b84-9c64-e7a0bc357a0d tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:36.389464 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-a0355ed6-84c2-4b84-9c64-e7a0bc357a0d tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:36.390217 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-a0355ed6-84c2-4b84-9c64-e7a0bc357a0d tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:36.390672 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-a0355ed6-84c2-4b84-9c64-e7a0bc357a0d tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:36.391118 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-a0355ed6-84c2-4b84-9c64-e7a0bc357a0d tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:36.534890 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-a0355ed6-84c2-4b84-9c64-e7a0bc357a0d tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:25:36.543519 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-a0355ed6-84c2-4b84-9c64-e7a0bc357a0d tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:25:36.544967 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-a0355ed6-84c2-4b84-9c64-e7a0bc357a0d tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:25:36.546106 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-a0355ed6-84c2-4b84-9c64-e7a0bc357a0d tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29" status: 200 len: 1408 microversion: 2.20 time: 0.169888 Oct 31 19:25:36.546693 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 312/623] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 31 19:25:36 2022] GET /compute/v2.1/servers/3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29 => generated 1408 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 19:25:37.571301 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-5d184d38-3420-48fc-bb0f-3c318e8fa26a tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:25:37.571990 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-5d184d38-3420-48fc-bb0f-3c318e8fa26a tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:25:37.578608 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-5d184d38-3420-48fc-bb0f-3c318e8fa26a tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:37.579083 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-5d184d38-3420-48fc-bb0f-3c318e8fa26a tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:37.579512 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-5d184d38-3420-48fc-bb0f-3c318e8fa26a tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:37.580237 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-5d184d38-3420-48fc-bb0f-3c318e8fa26a tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:37.580688 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-5d184d38-3420-48fc-bb0f-3c318e8fa26a tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:37.581108 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-5d184d38-3420-48fc-bb0f-3c318e8fa26a tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:37.759796 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-5d184d38-3420-48fc-bb0f-3c318e8fa26a tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:25:37.767771 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-5d184d38-3420-48fc-bb0f-3c318e8fa26a tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:25:37.769215 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-5d184d38-3420-48fc-bb0f-3c318e8fa26a tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:25:37.770840 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-5d184d38-3420-48fc-bb0f-3c318e8fa26a tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29" status: 200 len: 1408 microversion: 2.20 time: 0.203301 Oct 31 19:25:37.771594 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 312/624] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 31 19:25:37 2022] GET /compute/v2.1/servers/3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29 => generated 1408 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 19:25:38.338936 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [req-14287508-cf2b-4884-b558-553a59346731 req-9bd36b23-188c-4cbc-9583-23bea891bd66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29", "name": "network-vif-plugged", "status": "completed", "tag": "0e51264f-300d-49b6-9f03-c22ed061b801"}]} {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:25:38.348941 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [req-14287508-cf2b-4884-b558-553a59346731 req-9bd36b23-188c-4cbc-9583-23bea891bd66 service nova] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:38.349357 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [req-14287508-cf2b-4884-b558-553a59346731 req-9bd36b23-188c-4cbc-9583-23bea891bd66 service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:38.349804 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [req-14287508-cf2b-4884-b558-553a59346731 req-9bd36b23-188c-4cbc-9583-23bea891bd66 service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:38.352522 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG dbcounter [-] [118727] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:25:38.362676 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.compute.server_external_events [req-14287508-cf2b-4884-b558-553a59346731 req-9bd36b23-188c-4cbc-9583-23bea891bd66 service nova] Creating event network-vif-plugged:0e51264f-300d-49b6-9f03-c22ed061b801 for instance 3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29 on hv-cinder-86309 Oct 31 19:25:38.367750 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [req-14287508-cf2b-4884-b558-553a59346731 req-9bd36b23-188c-4cbc-9583-23bea891bd66 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032426 Oct 31 19:25:38.368356 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 313/625] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 31 19:25:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:25:38.796234 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-9f74cad8-fb87-4c59-972d-b995fffb16ef tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:25:38.796900 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-9f74cad8-fb87-4c59-972d-b995fffb16ef tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:25:38.804082 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-9f74cad8-fb87-4c59-972d-b995fffb16ef tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:38.804587 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-9f74cad8-fb87-4c59-972d-b995fffb16ef tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:38.805021 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-9f74cad8-fb87-4c59-972d-b995fffb16ef tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:38.805730 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-9f74cad8-fb87-4c59-972d-b995fffb16ef tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:38.806184 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-9f74cad8-fb87-4c59-972d-b995fffb16ef tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:38.806605 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-9f74cad8-fb87-4c59-972d-b995fffb16ef tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:38.935863 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-9f74cad8-fb87-4c59-972d-b995fffb16ef tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:25:38.944329 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-9f74cad8-fb87-4c59-972d-b995fffb16ef tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:25:38.945779 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-9f74cad8-fb87-4c59-972d-b995fffb16ef tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:25:38.946873 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-9f74cad8-fb87-4c59-972d-b995fffb16ef tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29" status: 200 len: 1408 microversion: 2.20 time: 0.154649 Oct 31 19:25:38.947436 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 313/626] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 31 19:25:38 2022] GET /compute/v2.1/servers/3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29 => generated 1408 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 19:25:39.969037 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG dbcounter [-] [118727] Writing DB stats nova_cell0:SELECT=4 {{(pid=118727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:25:39.969825 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG dbcounter [-] [118727] Writing DB stats nova_cell0:SELECT=16 {{(pid=118727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:25:39.974967 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-f7bd9464-a4fd-49c2-84d5-e268968fdb65 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:25:39.975660 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-f7bd9464-a4fd-49c2-84d5-e268968fdb65 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:25:39.982957 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-f7bd9464-a4fd-49c2-84d5-e268968fdb65 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:39.983437 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-f7bd9464-a4fd-49c2-84d5-e268968fdb65 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:39.983869 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-f7bd9464-a4fd-49c2-84d5-e268968fdb65 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:39.984600 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-f7bd9464-a4fd-49c2-84d5-e268968fdb65 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:39.985056 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-f7bd9464-a4fd-49c2-84d5-e268968fdb65 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:39.985498 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-f7bd9464-a4fd-49c2-84d5-e268968fdb65 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:40.114612 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-f7bd9464-a4fd-49c2-84d5-e268968fdb65 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:25:40.122534 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-f7bd9464-a4fd-49c2-84d5-e268968fdb65 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:25:40.123964 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-f7bd9464-a4fd-49c2-84d5-e268968fdb65 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:25:40.125053 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-f7bd9464-a4fd-49c2-84d5-e268968fdb65 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29" status: 200 len: 1408 microversion: 2.20 time: 0.157434 Oct 31 19:25:40.125661 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 314/627] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 31 19:25:39 2022] GET /compute/v2.1/servers/3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29 => generated 1408 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 19:25:41.151184 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG dbcounter [-] [118726] Writing DB stats nova_cell0:SELECT=4 {{(pid=118726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:25:41.203959 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-298a7a9d-92f0-429b-9b0e-ee7793ddd552 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:25:41.204570 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-298a7a9d-92f0-429b-9b0e-ee7793ddd552 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:25:41.210476 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-298a7a9d-92f0-429b-9b0e-ee7793ddd552 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:41.210957 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-298a7a9d-92f0-429b-9b0e-ee7793ddd552 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:41.211389 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-298a7a9d-92f0-429b-9b0e-ee7793ddd552 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:41.212078 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-298a7a9d-92f0-429b-9b0e-ee7793ddd552 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:41.212534 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-298a7a9d-92f0-429b-9b0e-ee7793ddd552 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:41.212963 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-298a7a9d-92f0-429b-9b0e-ee7793ddd552 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:41.336420 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-298a7a9d-92f0-429b-9b0e-ee7793ddd552 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:25:41.344381 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-298a7a9d-92f0-429b-9b0e-ee7793ddd552 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:25:41.345866 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-298a7a9d-92f0-429b-9b0e-ee7793ddd552 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:25:41.347015 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-298a7a9d-92f0-429b-9b0e-ee7793ddd552 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29" status: 200 len: 1600 microversion: 2.20 time: 0.200946 Oct 31 19:25:41.347597 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 314/628] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 31 19:25:41 2022] GET /compute/v2.1/servers/3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29 => generated 1600 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 19:25:41.371925 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-06bd97c1-1eb6-4546-85ac-70e1323506af tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:25:41.372419 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-06bd97c1-1eb6-4546-85ac-70e1323506af tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:25:41.378728 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-06bd97c1-1eb6-4546-85ac-70e1323506af tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:41.379205 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-06bd97c1-1eb6-4546-85ac-70e1323506af tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:41.379632 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-06bd97c1-1eb6-4546-85ac-70e1323506af tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:41.380363 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-06bd97c1-1eb6-4546-85ac-70e1323506af tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:41.380817 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-06bd97c1-1eb6-4546-85ac-70e1323506af tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:41.381234 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-06bd97c1-1eb6-4546-85ac-70e1323506af tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:41.457399 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-06bd97c1-1eb6-4546-85ac-70e1323506af tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.089238 Oct 31 19:25:41.458025 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 315/629] 10.222.0.16 () {60 vars in 1316 bytes} [Mon Oct 31 19:25:41 2022] GET /compute/v2.1/servers/3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 19:25:42.597582 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [req-d802faca-c5bf-4836-8feb-fd996af4fc79 req-1188d03f-9ee2-419f-a9df-edbe93e4a619 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29", "tag": "0e51264f-300d-49b6-9f03-c22ed061b801"}]} {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:25:42.603686 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG dbcounter [-] [118726] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1 {{(pid=118726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:25:42.609365 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [req-d802faca-c5bf-4836-8feb-fd996af4fc79 req-1188d03f-9ee2-419f-a9df-edbe93e4a619 service nova] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:42.609946 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [req-d802faca-c5bf-4836-8feb-fd996af4fc79 req-1188d03f-9ee2-419f-a9df-edbe93e4a619 service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:42.610438 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [req-d802faca-c5bf-4836-8feb-fd996af4fc79 req-1188d03f-9ee2-419f-a9df-edbe93e4a619 service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:42.622436 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.compute.server_external_events [req-d802faca-c5bf-4836-8feb-fd996af4fc79 req-1188d03f-9ee2-419f-a9df-edbe93e4a619 service nova] Creating event network-changed:0e51264f-300d-49b6-9f03-c22ed061b801 for instance 3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29 on hv-cinder-86309 Oct 31 19:25:42.627314 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [req-d802faca-c5bf-4836-8feb-fd996af4fc79 req-1188d03f-9ee2-419f-a9df-edbe93e4a619 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033486 Oct 31 19:25:42.627900 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 315/630] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 31 19:25:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 19:25:49.303797 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-8beab145-e9ca-4ac1-a269-1859519d3ad6 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:25:49.304294 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-8beab145-e9ca-4ac1-a269-1859519d3ad6 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 3097dda0-1cb7-439c-b44a-898c488a6448] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:25:49.310379 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-8beab145-e9ca-4ac1-a269-1859519d3ad6 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:49.310855 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-8beab145-e9ca-4ac1-a269-1859519d3ad6 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:49.311282 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-8beab145-e9ca-4ac1-a269-1859519d3ad6 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:49.311960 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-8beab145-e9ca-4ac1-a269-1859519d3ad6 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:49.312407 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-8beab145-e9ca-4ac1-a269-1859519d3ad6 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:49.312824 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-8beab145-e9ca-4ac1-a269-1859519d3ad6 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:49.391468 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.objects.instance [None req-8beab145-e9ca-4ac1-a269-1859519d3ad6 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lazy-loading 'services' on Instance uuid 3097dda0-1cb7-439c-b44a-898c488a6448 {{(pid=118727) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 19:25:49.463048 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-8beab145-e9ca-4ac1-a269-1859519d3ad6 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "DELETE /compute/v2.1/servers/3097dda0-1cb7-439c-b44a-898c488a6448/os-volume_attachments/10dfa9ba-1b6b-498e-b27b-3957452bb604" status: 202 len: 0 microversion: 2.1 time: 0.163825 Oct 31 19:25:49.463603 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 316/631] 10.222.0.16 () {58 vars in 1416 bytes} [Mon Oct 31 19:25:49 2022] DELETE /compute/v2.1/servers/3097dda0-1cb7-439c-b44a-898c488a6448/os-volume_attachments/10dfa9ba-1b6b-498e-b27b-3957452bb604 => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 19:25:49.472486 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-e674caf5-f287-4b84-ae64-7b576bddae8c tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:25:49.474924 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-e674caf5-f287-4b84-ae64-7b576bddae8c tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 3097dda0-1cb7-439c-b44a-898c488a6448] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:25:49.481790 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-e674caf5-f287-4b84-ae64-7b576bddae8c tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:49.482268 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-e674caf5-f287-4b84-ae64-7b576bddae8c tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:49.482698 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-e674caf5-f287-4b84-ae64-7b576bddae8c tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:49.483443 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-e674caf5-f287-4b84-ae64-7b576bddae8c tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:49.483906 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-e674caf5-f287-4b84-ae64-7b576bddae8c tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:49.484359 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-e674caf5-f287-4b84-ae64-7b576bddae8c tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:49.513398 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-e674caf5-f287-4b84-ae64-7b576bddae8c tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/3097dda0-1cb7-439c-b44a-898c488a6448/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045240 Oct 31 19:25:49.513983 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 316/632] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Oct 31 19:25:49 2022] GET /compute/v2.1/servers/3097dda0-1cb7-439c-b44a-898c488a6448/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:25:50.527895 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-d5fb3417-5090-4cf8-82a4-0428684eaeff tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:25:50.530187 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-d5fb3417-5090-4cf8-82a4-0428684eaeff tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 3097dda0-1cb7-439c-b44a-898c488a6448] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:25:50.536331 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-d5fb3417-5090-4cf8-82a4-0428684eaeff tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:50.536811 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-d5fb3417-5090-4cf8-82a4-0428684eaeff tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:50.537895 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-d5fb3417-5090-4cf8-82a4-0428684eaeff tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:50.538578 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-d5fb3417-5090-4cf8-82a4-0428684eaeff tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:50.539030 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-d5fb3417-5090-4cf8-82a4-0428684eaeff tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:50.539451 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-d5fb3417-5090-4cf8-82a4-0428684eaeff tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:50.568470 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-d5fb3417-5090-4cf8-82a4-0428684eaeff tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/3097dda0-1cb7-439c-b44a-898c488a6448/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045603 Oct 31 19:25:50.569020 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 317/633] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Oct 31 19:25:50 2022] GET /compute/v2.1/servers/3097dda0-1cb7-439c-b44a-898c488a6448/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 19:25:51.582150 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-53e71504-cead-4dba-8ed1-90934fd0c983 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:25:51.584920 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-53e71504-cead-4dba-8ed1-90934fd0c983 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 3097dda0-1cb7-439c-b44a-898c488a6448] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:25:51.591032 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-53e71504-cead-4dba-8ed1-90934fd0c983 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:51.591739 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-53e71504-cead-4dba-8ed1-90934fd0c983 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:51.592301 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-53e71504-cead-4dba-8ed1-90934fd0c983 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:51.593049 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-53e71504-cead-4dba-8ed1-90934fd0c983 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:51.593516 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-53e71504-cead-4dba-8ed1-90934fd0c983 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:51.593973 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-53e71504-cead-4dba-8ed1-90934fd0c983 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:51.598599 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-6aff6e54-3fb8-4131-ba24-be74ef201f7f tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:25:51.601394 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-6aff6e54-3fb8-4131-ba24-be74ef201f7f tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] [instance: 0a122a08-bc0f-40fd-8139-74c9e8a70ebe] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:25:51.608062 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-6aff6e54-3fb8-4131-ba24-be74ef201f7f tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:51.608788 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-6aff6e54-3fb8-4131-ba24-be74ef201f7f tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:51.609391 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-6aff6e54-3fb8-4131-ba24-be74ef201f7f tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:51.610318 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-6aff6e54-3fb8-4131-ba24-be74ef201f7f tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:51.611018 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-6aff6e54-3fb8-4131-ba24-be74ef201f7f tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:51.611667 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-6aff6e54-3fb8-4131-ba24-be74ef201f7f tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:51.627361 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-53e71504-cead-4dba-8ed1-90934fd0c983 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/3097dda0-1cb7-439c-b44a-898c488a6448/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050828 Oct 31 19:25:51.627925 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 317/634] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Oct 31 19:25:51 2022] GET /compute/v2.1/servers/3097dda0-1cb7-439c-b44a-898c488a6448/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:25:51.645708 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-6aff6e54-3fb8-4131-ba24-be74ef201f7f tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] 10.222.0.16 "GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051006 Oct 31 19:25:51.646828 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 318/635] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Oct 31 19:25:51 2022] GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 19:25:51.711931 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-fd70a1a5-b1cb-493b-b948-8975a16c3744 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:25:51.712437 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-fd70a1a5-b1cb-493b-b948-8975a16c3744 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] [instance: 0a122a08-bc0f-40fd-8139-74c9e8a70ebe] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:25:51.718337 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-fd70a1a5-b1cb-493b-b948-8975a16c3744 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:51.718824 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-fd70a1a5-b1cb-493b-b948-8975a16c3744 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:51.719257 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-fd70a1a5-b1cb-493b-b948-8975a16c3744 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:51.719950 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-fd70a1a5-b1cb-493b-b948-8975a16c3744 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:51.720404 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-fd70a1a5-b1cb-493b-b948-8975a16c3744 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:51.720835 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-fd70a1a5-b1cb-493b-b948-8975a16c3744 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:51.748251 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-fd70a1a5-b1cb-493b-b948-8975a16c3744 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] [instance: 0a122a08-bc0f-40fd-8139-74c9e8a70ebe] Going to try to terminate instance {{(pid=118726) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 19:25:51.828217 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-fd70a1a5-b1cb-493b-b948-8975a16c3744 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] 10.222.0.16 "DELETE /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe" status: 204 len: 0 microversion: 2.1 time: 0.120384 Oct 31 19:25:51.828914 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 318/636] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 31 19:25:51 2022] DELETE /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 19:25:51.838373 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-cc46d6de-3400-4ab5-984c-adda9603bb7b tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:25:51.839077 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-cc46d6de-3400-4ab5-984c-adda9603bb7b tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] [instance: 0a122a08-bc0f-40fd-8139-74c9e8a70ebe] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:25:51.845083 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-cc46d6de-3400-4ab5-984c-adda9603bb7b tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:51.845662 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-cc46d6de-3400-4ab5-984c-adda9603bb7b tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:51.846167 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-cc46d6de-3400-4ab5-984c-adda9603bb7b tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:51.846917 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-cc46d6de-3400-4ab5-984c-adda9603bb7b tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:51.847462 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-cc46d6de-3400-4ab5-984c-adda9603bb7b tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:51.847952 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-cc46d6de-3400-4ab5-984c-adda9603bb7b tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:51.982370 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-cc46d6de-3400-4ab5-984c-adda9603bb7b tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ece6ca9374764214bac6263bd691bc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9c317b548b40deb8cb27236d36d674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:25:51.990553 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-cc46d6de-3400-4ab5-984c-adda9603bb7b tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] 10.222.0.16 "GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe" status: 200 len: 1671 microversion: 2.1 time: 0.156067 Oct 31 19:25:51.991121 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 319/637] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:25:51 2022] GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe => generated 1671 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:25:52.694799 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-8bae937d-2c18-4330-9230-8605b75b59e7 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:25:52.697087 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-8bae937d-2c18-4330-9230-8605b75b59e7 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 3097dda0-1cb7-439c-b44a-898c488a6448] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:25:52.703054 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-8bae937d-2c18-4330-9230-8605b75b59e7 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:52.703536 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-8bae937d-2c18-4330-9230-8605b75b59e7 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:52.703971 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-8bae937d-2c18-4330-9230-8605b75b59e7 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:52.704651 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-8bae937d-2c18-4330-9230-8605b75b59e7 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:52.705105 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-8bae937d-2c18-4330-9230-8605b75b59e7 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:52.705527 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-8bae937d-2c18-4330-9230-8605b75b59e7 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:52.735603 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-8bae937d-2c18-4330-9230-8605b75b59e7 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/3097dda0-1cb7-439c-b44a-898c488a6448/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.098824 Oct 31 19:25:52.736166 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 319/638] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Oct 31 19:25:52 2022] GET /compute/v2.1/servers/3097dda0-1cb7-439c-b44a-898c488a6448/os-volume_attachments => generated 197 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:25:53.114595 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-f4054b0f-257a-40da-a40d-74a6b914d589 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:25:53.115795 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-f4054b0f-257a-40da-a40d-74a6b914d589 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] [instance: 0a122a08-bc0f-40fd-8139-74c9e8a70ebe] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:25:53.121683 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-f4054b0f-257a-40da-a40d-74a6b914d589 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:53.122161 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-f4054b0f-257a-40da-a40d-74a6b914d589 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:53.122595 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-f4054b0f-257a-40da-a40d-74a6b914d589 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:53.123280 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-f4054b0f-257a-40da-a40d-74a6b914d589 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:53.123742 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-f4054b0f-257a-40da-a40d-74a6b914d589 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:53.124161 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-f4054b0f-257a-40da-a40d-74a6b914d589 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:53.253189 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-f4054b0f-257a-40da-a40d-74a6b914d589 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ece6ca9374764214bac6263bd691bc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9c317b548b40deb8cb27236d36d674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:25:53.261276 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-f4054b0f-257a-40da-a40d-74a6b914d589 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] 10.222.0.16 "GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe" status: 200 len: 1671 microversion: 2.1 time: 0.249645 Oct 31 19:25:53.261877 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 320/639] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:25:53 2022] GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe => generated 1671 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:25:53.748437 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-f2b17702-ec3b-4b64-be71-2d9687aea028 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:25:53.750570 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-f2b17702-ec3b-4b64-be71-2d9687aea028 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 3097dda0-1cb7-439c-b44a-898c488a6448] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:25:53.756745 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-f2b17702-ec3b-4b64-be71-2d9687aea028 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:53.757219 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-f2b17702-ec3b-4b64-be71-2d9687aea028 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:53.757676 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-f2b17702-ec3b-4b64-be71-2d9687aea028 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:53.758349 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-f2b17702-ec3b-4b64-be71-2d9687aea028 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:53.758826 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-f2b17702-ec3b-4b64-be71-2d9687aea028 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:53.759240 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-f2b17702-ec3b-4b64-be71-2d9687aea028 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:53.788254 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-f2b17702-ec3b-4b64-be71-2d9687aea028 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/3097dda0-1cb7-439c-b44a-898c488a6448/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043751 Oct 31 19:25:53.788805 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 320/640] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Oct 31 19:25:53 2022] GET /compute/v2.1/servers/3097dda0-1cb7-439c-b44a-898c488a6448/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:25:54.284285 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-3f01ba79-a33c-4cb2-b576-be59ecbc6e4f tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:25:54.284896 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-3f01ba79-a33c-4cb2-b576-be59ecbc6e4f tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] [instance: 0a122a08-bc0f-40fd-8139-74c9e8a70ebe] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:25:54.292274 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-3f01ba79-a33c-4cb2-b576-be59ecbc6e4f tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:54.292692 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-3f01ba79-a33c-4cb2-b576-be59ecbc6e4f tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:54.293136 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-3f01ba79-a33c-4cb2-b576-be59ecbc6e4f tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:54.293887 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-3f01ba79-a33c-4cb2-b576-be59ecbc6e4f tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:54.294342 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-3f01ba79-a33c-4cb2-b576-be59ecbc6e4f tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:54.303536 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-3f01ba79-a33c-4cb2-b576-be59ecbc6e4f tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:54.470643 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-3f01ba79-a33c-4cb2-b576-be59ecbc6e4f tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ece6ca9374764214bac6263bd691bc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9c317b548b40deb8cb27236d36d674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:25:54.478987 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-3f01ba79-a33c-4cb2-b576-be59ecbc6e4f tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] 10.222.0.16 "GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe" status: 200 len: 1671 microversion: 2.1 time: 0.198558 Oct 31 19:25:54.479486 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 321/641] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:25:54 2022] GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe => generated 1671 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:25:54.803573 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-8538025f-ea38-4afd-b57f-26eef707732c tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:25:54.805981 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-8538025f-ea38-4afd-b57f-26eef707732c tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 3097dda0-1cb7-439c-b44a-898c488a6448] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:25:54.812705 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-8538025f-ea38-4afd-b57f-26eef707732c tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:54.813507 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-8538025f-ea38-4afd-b57f-26eef707732c tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:54.814175 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-8538025f-ea38-4afd-b57f-26eef707732c tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:54.815508 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-8538025f-ea38-4afd-b57f-26eef707732c tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:54.816130 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-8538025f-ea38-4afd-b57f-26eef707732c tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:54.816545 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-8538025f-ea38-4afd-b57f-26eef707732c tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:54.847154 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-8538025f-ea38-4afd-b57f-26eef707732c tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/3097dda0-1cb7-439c-b44a-898c488a6448/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049978 Oct 31 19:25:54.847719 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 321/642] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Oct 31 19:25:54 2022] GET /compute/v2.1/servers/3097dda0-1cb7-439c-b44a-898c488a6448/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 19:25:54.931502 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-2fd491ee-a43c-48fe-84ce-42da130d21cf tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:25:54.932187 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-2fd491ee-a43c-48fe-84ce-42da130d21cf tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 3097dda0-1cb7-439c-b44a-898c488a6448] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:25:54.938194 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-2fd491ee-a43c-48fe-84ce-42da130d21cf tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:54.938668 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-2fd491ee-a43c-48fe-84ce-42da130d21cf tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:54.939101 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-2fd491ee-a43c-48fe-84ce-42da130d21cf tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:54.939776 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-2fd491ee-a43c-48fe-84ce-42da130d21cf tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:54.940222 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-2fd491ee-a43c-48fe-84ce-42da130d21cf tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:54.940638 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-2fd491ee-a43c-48fe-84ce-42da130d21cf tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:54.965977 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-2fd491ee-a43c-48fe-84ce-42da130d21cf tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 3097dda0-1cb7-439c-b44a-898c488a6448] Going to try to terminate instance {{(pid=118727) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 19:25:55.040459 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-2fd491ee-a43c-48fe-84ce-42da130d21cf tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "DELETE /compute/v2.1/servers/3097dda0-1cb7-439c-b44a-898c488a6448" status: 204 len: 0 microversion: 2.1 time: 0.113035 Oct 31 19:25:55.041459 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 322/643] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 31 19:25:54 2022] DELETE /compute/v2.1/servers/3097dda0-1cb7-439c-b44a-898c488a6448 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 19:25:55.050029 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-8c583f26-5eeb-4ecf-8b0d-81d93b433a62 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:25:55.050727 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-8c583f26-5eeb-4ecf-8b0d-81d93b433a62 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 3097dda0-1cb7-439c-b44a-898c488a6448] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:25:55.057135 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-8c583f26-5eeb-4ecf-8b0d-81d93b433a62 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:55.057635 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-8c583f26-5eeb-4ecf-8b0d-81d93b433a62 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:55.058094 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-8c583f26-5eeb-4ecf-8b0d-81d93b433a62 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:55.058779 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-8c583f26-5eeb-4ecf-8b0d-81d93b433a62 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:55.059232 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-8c583f26-5eeb-4ecf-8b0d-81d93b433a62 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:55.059654 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-8c583f26-5eeb-4ecf-8b0d-81d93b433a62 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:55.187960 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-8c583f26-5eeb-4ecf-8b0d-81d93b433a62 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc49f9eb3114759b2889ed8972136d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cf63c76fc543428404002ae9a75b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:25:55.195588 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-8c583f26-5eeb-4ecf-8b0d-81d93b433a62 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/3097dda0-1cb7-439c-b44a-898c488a6448" status: 200 len: 1687 microversion: 2.1 time: 0.149990 Oct 31 19:25:55.196151 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 322/644] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:25:55 2022] GET /compute/v2.1/servers/3097dda0-1cb7-439c-b44a-898c488a6448 => generated 1687 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:25:55.502485 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-df7061a4-a3d2-48aa-b6ff-23f7d78e445f tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:25:55.503213 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-df7061a4-a3d2-48aa-b6ff-23f7d78e445f tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] [instance: 0a122a08-bc0f-40fd-8139-74c9e8a70ebe] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:25:55.509547 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-df7061a4-a3d2-48aa-b6ff-23f7d78e445f tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:55.510058 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-df7061a4-a3d2-48aa-b6ff-23f7d78e445f tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:55.510519 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-df7061a4-a3d2-48aa-b6ff-23f7d78e445f tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:55.511204 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-df7061a4-a3d2-48aa-b6ff-23f7d78e445f tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:55.511656 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-df7061a4-a3d2-48aa-b6ff-23f7d78e445f tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:55.512074 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-df7061a4-a3d2-48aa-b6ff-23f7d78e445f tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:55.602975 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-df7061a4-a3d2-48aa-b6ff-23f7d78e445f tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ece6ca9374764214bac6263bd691bc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9c317b548b40deb8cb27236d36d674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:25:55.612155 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-df7061a4-a3d2-48aa-b6ff-23f7d78e445f tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] 10.222.0.16 "GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe" status: 200 len: 1604 microversion: 2.1 time: 0.113830 Oct 31 19:25:55.612850 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 323/645] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:25:55 2022] GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe => generated 1604 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:25:55.613906 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [req-c0f33288-b275-42e1-ac5a-0f12c031eae0 req-8a0a1f3c-f9eb-45af-8df4-5396031091ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a122a08-bc0f-40fd-8139-74c9e8a70ebe", "name": "network-vif-deleted", "tag": "810ffdd3-13de-43d5-a09c-221911cc3bcf"}]} {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:25:55.623986 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [req-c0f33288-b275-42e1-ac5a-0f12c031eae0 req-8a0a1f3c-f9eb-45af-8df4-5396031091ea service nova] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:55.624662 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [req-c0f33288-b275-42e1-ac5a-0f12c031eae0 req-8a0a1f3c-f9eb-45af-8df4-5396031091ea service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:55.625271 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [req-c0f33288-b275-42e1-ac5a-0f12c031eae0 req-8a0a1f3c-f9eb-45af-8df4-5396031091ea service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:55.638142 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.compute.server_external_events [req-c0f33288-b275-42e1-ac5a-0f12c031eae0 req-8a0a1f3c-f9eb-45af-8df4-5396031091ea service nova] Creating event network-vif-deleted:810ffdd3-13de-43d5-a09c-221911cc3bcf for instance 0a122a08-bc0f-40fd-8139-74c9e8a70ebe on hv-cinder-86309 Oct 31 19:25:55.647256 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [req-c0f33288-b275-42e1-ac5a-0f12c031eae0 req-8a0a1f3c-f9eb-45af-8df4-5396031091ea service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036846 Oct 31 19:25:55.647473 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-d02c0a11-d152-4fab-be65-72f6b8e521dc tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:25:55.648154 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-d02c0a11-d152-4fab-be65-72f6b8e521dc tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] [instance: 95bfc882-6f9e-4736-9ee4-00f63c5892ff] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:25:55.648524 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 323/646] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 31 19:25:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:25:55.654639 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-d02c0a11-d152-4fab-be65-72f6b8e521dc tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:55.655078 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-d02c0a11-d152-4fab-be65-72f6b8e521dc tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:55.655512 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-d02c0a11-d152-4fab-be65-72f6b8e521dc tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:55.656214 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-d02c0a11-d152-4fab-be65-72f6b8e521dc tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:55.656665 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-d02c0a11-d152-4fab-be65-72f6b8e521dc tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:55.657091 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-d02c0a11-d152-4fab-be65-72f6b8e521dc tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:55.745654 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.objects.instance [None req-d02c0a11-d152-4fab-be65-72f6b8e521dc tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Lazy-loading 'services' on Instance uuid 95bfc882-6f9e-4736-9ee4-00f63c5892ff {{(pid=118727) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 19:25:55.830774 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-d02c0a11-d152-4fab-be65-72f6b8e521dc tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] 10.222.0.16 "DELETE /compute/v2.1/servers/95bfc882-6f9e-4736-9ee4-00f63c5892ff/os-volume_attachments/5f393cdb-f88b-4045-81c5-627809da8680" status: 202 len: 0 microversion: 2.1 time: 0.187225 Oct 31 19:25:55.831581 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 324/647] 10.222.0.16 () {58 vars in 1416 bytes} [Mon Oct 31 19:25:55 2022] DELETE /compute/v2.1/servers/95bfc882-6f9e-4736-9ee4-00f63c5892ff/os-volume_attachments/5f393cdb-f88b-4045-81c5-627809da8680 => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 31 19:25:56.220195 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-ccdb4b4e-7fb4-4c5c-8d30-a07ef0bac7fe tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:25:56.220821 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-ccdb4b4e-7fb4-4c5c-8d30-a07ef0bac7fe tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 3097dda0-1cb7-439c-b44a-898c488a6448] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:25:56.227613 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-ccdb4b4e-7fb4-4c5c-8d30-a07ef0bac7fe tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:56.228087 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-ccdb4b4e-7fb4-4c5c-8d30-a07ef0bac7fe tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:56.228519 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-ccdb4b4e-7fb4-4c5c-8d30-a07ef0bac7fe tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:56.229201 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-ccdb4b4e-7fb4-4c5c-8d30-a07ef0bac7fe tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:56.229677 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-ccdb4b4e-7fb4-4c5c-8d30-a07ef0bac7fe tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:56.230099 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-ccdb4b4e-7fb4-4c5c-8d30-a07ef0bac7fe tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:56.363528 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-ccdb4b4e-7fb4-4c5c-8d30-a07ef0bac7fe tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc49f9eb3114759b2889ed8972136d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cf63c76fc543428404002ae9a75b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:25:56.372417 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-ccdb4b4e-7fb4-4c5c-8d30-a07ef0bac7fe tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/3097dda0-1cb7-439c-b44a-898c488a6448" status: 200 len: 1687 microversion: 2.1 time: 0.156976 Oct 31 19:25:56.372992 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 324/648] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:25:56 2022] GET /compute/v2.1/servers/3097dda0-1cb7-439c-b44a-898c488a6448 => generated 1687 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:25:56.637096 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-236a7df1-7d55-45ff-8583-c983bac99087 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:25:56.637817 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-236a7df1-7d55-45ff-8583-c983bac99087 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] [instance: 0a122a08-bc0f-40fd-8139-74c9e8a70ebe] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:25:56.644707 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-236a7df1-7d55-45ff-8583-c983bac99087 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:56.645185 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-236a7df1-7d55-45ff-8583-c983bac99087 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:56.645654 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-236a7df1-7d55-45ff-8583-c983bac99087 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:56.646814 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-236a7df1-7d55-45ff-8583-c983bac99087 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:56.647260 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-236a7df1-7d55-45ff-8583-c983bac99087 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:56.647676 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-236a7df1-7d55-45ff-8583-c983bac99087 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:56.709572 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-236a7df1-7d55-45ff-8583-c983bac99087 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ece6ca9374764214bac6263bd691bc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9c317b548b40deb8cb27236d36d674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:25:56.717067 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-236a7df1-7d55-45ff-8583-c983bac99087 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] 10.222.0.16 "GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe" status: 200 len: 1604 microversion: 2.1 time: 0.084506 Oct 31 19:25:56.717678 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 325/649] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:25:56 2022] GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe => generated 1604 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:25:57.395614 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-9511f6d7-b679-47d5-82e3-3ee8a758f5d2 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:25:57.396265 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-9511f6d7-b679-47d5-82e3-3ee8a758f5d2 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 3097dda0-1cb7-439c-b44a-898c488a6448] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:25:57.402603 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-9511f6d7-b679-47d5-82e3-3ee8a758f5d2 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:57.403080 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-9511f6d7-b679-47d5-82e3-3ee8a758f5d2 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:57.403509 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-9511f6d7-b679-47d5-82e3-3ee8a758f5d2 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:57.404188 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-9511f6d7-b679-47d5-82e3-3ee8a758f5d2 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:57.404637 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-9511f6d7-b679-47d5-82e3-3ee8a758f5d2 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:57.405054 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-9511f6d7-b679-47d5-82e3-3ee8a758f5d2 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:57.529682 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-9511f6d7-b679-47d5-82e3-3ee8a758f5d2 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc49f9eb3114759b2889ed8972136d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cf63c76fc543428404002ae9a75b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:25:57.537755 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-9511f6d7-b679-47d5-82e3-3ee8a758f5d2 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/3097dda0-1cb7-439c-b44a-898c488a6448" status: 200 len: 1687 microversion: 2.1 time: 0.145999 Oct 31 19:25:57.538317 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 325/650] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:25:57 2022] GET /compute/v2.1/servers/3097dda0-1cb7-439c-b44a-898c488a6448 => generated 1687 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:25:57.740703 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-27e28f66-718c-483f-ba45-a2d399b88f04 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:25:57.741407 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-27e28f66-718c-483f-ba45-a2d399b88f04 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] [instance: 0a122a08-bc0f-40fd-8139-74c9e8a70ebe] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:25:57.747672 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-27e28f66-718c-483f-ba45-a2d399b88f04 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:57.748143 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-27e28f66-718c-483f-ba45-a2d399b88f04 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:57.748567 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-27e28f66-718c-483f-ba45-a2d399b88f04 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:57.749241 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-27e28f66-718c-483f-ba45-a2d399b88f04 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:57.749724 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-27e28f66-718c-483f-ba45-a2d399b88f04 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:57.750141 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-27e28f66-718c-483f-ba45-a2d399b88f04 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:57.811255 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-27e28f66-718c-483f-ba45-a2d399b88f04 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ece6ca9374764214bac6263bd691bc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9c317b548b40deb8cb27236d36d674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:25:57.818875 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-27e28f66-718c-483f-ba45-a2d399b88f04 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] 10.222.0.16 "GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe" status: 200 len: 1604 microversion: 2.1 time: 0.082566 Oct 31 19:25:57.819435 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 326/651] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:25:57 2022] GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe => generated 1604 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:25:58.561670 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-1cc0354a-330c-46c2-a814-9c0ae0b1ad0b tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:25:58.562286 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-1cc0354a-330c-46c2-a814-9c0ae0b1ad0b tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 3097dda0-1cb7-439c-b44a-898c488a6448] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:25:58.569189 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-1cc0354a-330c-46c2-a814-9c0ae0b1ad0b tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:58.569688 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-1cc0354a-330c-46c2-a814-9c0ae0b1ad0b tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:58.570127 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-1cc0354a-330c-46c2-a814-9c0ae0b1ad0b tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:58.570809 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-1cc0354a-330c-46c2-a814-9c0ae0b1ad0b tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:58.571266 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-1cc0354a-330c-46c2-a814-9c0ae0b1ad0b tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:58.571691 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-1cc0354a-330c-46c2-a814-9c0ae0b1ad0b tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:58.705185 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-1cc0354a-330c-46c2-a814-9c0ae0b1ad0b tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc49f9eb3114759b2889ed8972136d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cf63c76fc543428404002ae9a75b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:25:58.714252 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-1cc0354a-330c-46c2-a814-9c0ae0b1ad0b tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/3097dda0-1cb7-439c-b44a-898c488a6448" status: 200 len: 1687 microversion: 2.1 time: 0.156459 Oct 31 19:25:58.714821 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 326/652] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:25:58 2022] GET /compute/v2.1/servers/3097dda0-1cb7-439c-b44a-898c488a6448 => generated 1687 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:25:58.841045 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-81cc1c3d-dce2-4194-8e7f-ebd9f9416933 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:25:58.841582 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-81cc1c3d-dce2-4194-8e7f-ebd9f9416933 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] [instance: 0a122a08-bc0f-40fd-8139-74c9e8a70ebe] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:25:58.847903 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-81cc1c3d-dce2-4194-8e7f-ebd9f9416933 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:58.848381 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-81cc1c3d-dce2-4194-8e7f-ebd9f9416933 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:58.848810 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-81cc1c3d-dce2-4194-8e7f-ebd9f9416933 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:58.850089 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-81cc1c3d-dce2-4194-8e7f-ebd9f9416933 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:58.850565 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-81cc1c3d-dce2-4194-8e7f-ebd9f9416933 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:58.850985 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-81cc1c3d-dce2-4194-8e7f-ebd9f9416933 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:58.881760 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-81cc1c3d-dce2-4194-8e7f-ebd9f9416933 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:58.882258 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-81cc1c3d-dce2-4194-8e7f-ebd9f9416933 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:58.882696 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-81cc1c3d-dce2-4194-8e7f-ebd9f9416933 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:58.883141 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.objects.instance [None req-81cc1c3d-dce2-4194-8e7f-ebd9f9416933 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lazy-loading 'fault' on Instance uuid 0a122a08-bc0f-40fd-8139-74c9e8a70ebe {{(pid=118727) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 19:25:58.886726 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG dbcounter [-] [118727] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=118727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:25:58.930665 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-81cc1c3d-dce2-4194-8e7f-ebd9f9416933 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ece6ca9374764214bac6263bd691bc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9c317b548b40deb8cb27236d36d674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:25:58.938653 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-81cc1c3d-dce2-4194-8e7f-ebd9f9416933 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] 10.222.0.16 "GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe" status: 200 len: 1327 microversion: 2.1 time: 0.101462 Oct 31 19:25:58.939276 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 327/653] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:25:58 2022] GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe => generated 1327 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:25:59.737443 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-cb700a54-1e25-4dd5-952a-378532c45e5f tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:25:59.738115 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-cb700a54-1e25-4dd5-952a-378532c45e5f tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 3097dda0-1cb7-439c-b44a-898c488a6448] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:25:59.745104 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-cb700a54-1e25-4dd5-952a-378532c45e5f tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:59.745581 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-cb700a54-1e25-4dd5-952a-378532c45e5f tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:59.746052 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-cb700a54-1e25-4dd5-952a-378532c45e5f tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:59.746737 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-cb700a54-1e25-4dd5-952a-378532c45e5f tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:59.747191 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-cb700a54-1e25-4dd5-952a-378532c45e5f tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:59.747610 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-cb700a54-1e25-4dd5-952a-378532c45e5f tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:59.763104 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG dbcounter [-] [118726] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:25:59.879676 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-cb700a54-1e25-4dd5-952a-378532c45e5f tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc49f9eb3114759b2889ed8972136d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cf63c76fc543428404002ae9a75b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:25:59.888470 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-cb700a54-1e25-4dd5-952a-378532c45e5f tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/3097dda0-1cb7-439c-b44a-898c488a6448" status: 200 len: 1687 microversion: 2.1 time: 0.155006 Oct 31 19:25:59.889136 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 327/654] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:25:59 2022] GET /compute/v2.1/servers/3097dda0-1cb7-439c-b44a-898c488a6448 => generated 1687 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:25:59.961705 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-139ad97e-8683-4be9-9fb8-e42b1bf16554 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:25:59.962846 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-139ad97e-8683-4be9-9fb8-e42b1bf16554 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] [instance: 0a122a08-bc0f-40fd-8139-74c9e8a70ebe] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:25:59.970368 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-139ad97e-8683-4be9-9fb8-e42b1bf16554 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:59.971126 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-139ad97e-8683-4be9-9fb8-e42b1bf16554 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:59.971634 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-139ad97e-8683-4be9-9fb8-e42b1bf16554 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:25:59.972605 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-139ad97e-8683-4be9-9fb8-e42b1bf16554 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:25:59.973129 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-139ad97e-8683-4be9-9fb8-e42b1bf16554 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:25:59.973639 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-139ad97e-8683-4be9-9fb8-e42b1bf16554 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:00.012490 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-139ad97e-8683-4be9-9fb8-e42b1bf16554 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:00.013162 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-139ad97e-8683-4be9-9fb8-e42b1bf16554 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:00.013624 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-139ad97e-8683-4be9-9fb8-e42b1bf16554 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:00.014182 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.objects.instance [None req-139ad97e-8683-4be9-9fb8-e42b1bf16554 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lazy-loading 'fault' on Instance uuid 0a122a08-bc0f-40fd-8139-74c9e8a70ebe {{(pid=118727) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 19:26:00.062244 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-139ad97e-8683-4be9-9fb8-e42b1bf16554 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ece6ca9374764214bac6263bd691bc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9c317b548b40deb8cb27236d36d674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:00.079920 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-139ad97e-8683-4be9-9fb8-e42b1bf16554 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] 10.222.0.16 "GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe" status: 200 len: 1327 microversion: 2.1 time: 0.122163 Oct 31 19:26:00.091067 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 328/655] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:25:59 2022] GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe => generated 1327 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:26:00.138984 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-86d006bc-2d07-4bee-8ab2-007d98f029f1 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:26:00.139403 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-86d006bc-2d07-4bee-8ab2-007d98f029f1 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] [instance: 95bfc882-6f9e-4736-9ee4-00f63c5892ff] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:26:00.145199 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-86d006bc-2d07-4bee-8ab2-007d98f029f1 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:00.145711 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-86d006bc-2d07-4bee-8ab2-007d98f029f1 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:00.146663 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-86d006bc-2d07-4bee-8ab2-007d98f029f1 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:00.147341 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-86d006bc-2d07-4bee-8ab2-007d98f029f1 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:00.147791 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-86d006bc-2d07-4bee-8ab2-007d98f029f1 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:00.148205 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-86d006bc-2d07-4bee-8ab2-007d98f029f1 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:00.173111 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-86d006bc-2d07-4bee-8ab2-007d98f029f1 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] [instance: 95bfc882-6f9e-4736-9ee4-00f63c5892ff] Going to try to terminate instance {{(pid=118726) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 19:26:00.243320 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [req-8e52dc94-38c9-4e36-bf09-73903b2544b1 req-44d3f11e-694f-4be4-a9f3-256a1133fc6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3097dda0-1cb7-439c-b44a-898c488a6448", "name": "network-vif-deleted", "tag": "47bfb5db-2a8e-49bb-8942-819d0c5b71da"}]} {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:26:00.256877 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [req-8e52dc94-38c9-4e36-bf09-73903b2544b1 req-44d3f11e-694f-4be4-a9f3-256a1133fc6e service nova] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:00.258436 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [req-8e52dc94-38c9-4e36-bf09-73903b2544b1 req-44d3f11e-694f-4be4-a9f3-256a1133fc6e service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:00.259196 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [req-8e52dc94-38c9-4e36-bf09-73903b2544b1 req-44d3f11e-694f-4be4-a9f3-256a1133fc6e service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:00.280230 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.compute.server_external_events [req-8e52dc94-38c9-4e36-bf09-73903b2544b1 req-44d3f11e-694f-4be4-a9f3-256a1133fc6e service nova] Creating event network-vif-deleted:47bfb5db-2a8e-49bb-8942-819d0c5b71da for instance 3097dda0-1cb7-439c-b44a-898c488a6448 on hv-cinder-86309 Oct 31 19:26:00.287382 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-86d006bc-2d07-4bee-8ab2-007d98f029f1 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] 10.222.0.16 "DELETE /compute/v2.1/servers/95bfc882-6f9e-4736-9ee4-00f63c5892ff" status: 204 len: 0 microversion: 2.1 time: 0.150894 Oct 31 19:26:00.288265 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 328/656] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 31 19:26:00 2022] DELETE /compute/v2.1/servers/95bfc882-6f9e-4736-9ee4-00f63c5892ff => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 31 19:26:00.294022 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [req-8e52dc94-38c9-4e36-bf09-73903b2544b1 req-44d3f11e-694f-4be4-a9f3-256a1133fc6e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055948 Oct 31 19:26:00.295236 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 329/657] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 31 19:26:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:26:00.300467 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-e4d6ad5e-0618-4cc3-8b9b-7e4c4b82668b tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:26:00.301458 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-e4d6ad5e-0618-4cc3-8b9b-7e4c4b82668b tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] [instance: 95bfc882-6f9e-4736-9ee4-00f63c5892ff] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:26:00.308285 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-e4d6ad5e-0618-4cc3-8b9b-7e4c4b82668b tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:00.309306 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-e4d6ad5e-0618-4cc3-8b9b-7e4c4b82668b tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:00.309927 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-e4d6ad5e-0618-4cc3-8b9b-7e4c4b82668b tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:00.310783 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-e4d6ad5e-0618-4cc3-8b9b-7e4c4b82668b tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:00.311420 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-e4d6ad5e-0618-4cc3-8b9b-7e4c4b82668b tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:00.312279 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-e4d6ad5e-0618-4cc3-8b9b-7e4c4b82668b tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:00.455610 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-e4d6ad5e-0618-4cc3-8b9b-7e4c4b82668b tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbeda8236874f2ca69a6638c626e466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2956107c4664ccd8a7517a707982d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:00.464223 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-e4d6ad5e-0618-4cc3-8b9b-7e4c4b82668b tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] 10.222.0.16 "GET /compute/v2.1/servers/95bfc882-6f9e-4736-9ee4-00f63c5892ff" status: 200 len: 1513 microversion: 2.1 time: 0.170769 Oct 31 19:26:00.464801 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 329/658] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:26:00 2022] GET /compute/v2.1/servers/95bfc882-6f9e-4736-9ee4-00f63c5892ff => generated 1513 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 19:26:00.912250 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-e62779d3-3c64-4a3d-a08e-2b721d55c5f6 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:26:00.912954 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-e62779d3-3c64-4a3d-a08e-2b721d55c5f6 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 3097dda0-1cb7-439c-b44a-898c488a6448] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:26:00.919749 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-e62779d3-3c64-4a3d-a08e-2b721d55c5f6 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:00.920237 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-e62779d3-3c64-4a3d-a08e-2b721d55c5f6 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:00.920669 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-e62779d3-3c64-4a3d-a08e-2b721d55c5f6 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:00.921366 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-e62779d3-3c64-4a3d-a08e-2b721d55c5f6 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:00.921855 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-e62779d3-3c64-4a3d-a08e-2b721d55c5f6 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:00.922281 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-e62779d3-3c64-4a3d-a08e-2b721d55c5f6 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:00.988785 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-e62779d3-3c64-4a3d-a08e-2b721d55c5f6 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc49f9eb3114759b2889ed8972136d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cf63c76fc543428404002ae9a75b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:00.997330 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-e62779d3-3c64-4a3d-a08e-2b721d55c5f6 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/3097dda0-1cb7-439c-b44a-898c488a6448" status: 200 len: 1331 microversion: 2.1 time: 0.089341 Oct 31 19:26:00.997790 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 330/659] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:26:00 2022] GET /compute/v2.1/servers/3097dda0-1cb7-439c-b44a-898c488a6448 => generated 1331 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:26:01.104275 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-ea92164c-ff20-4253-ac90-75ad7135d119 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:26:01.104920 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-ea92164c-ff20-4253-ac90-75ad7135d119 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] [instance: 0a122a08-bc0f-40fd-8139-74c9e8a70ebe] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:26:01.111333 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-ea92164c-ff20-4253-ac90-75ad7135d119 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:01.111816 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-ea92164c-ff20-4253-ac90-75ad7135d119 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:01.112249 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-ea92164c-ff20-4253-ac90-75ad7135d119 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:01.112929 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-ea92164c-ff20-4253-ac90-75ad7135d119 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:01.113387 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-ea92164c-ff20-4253-ac90-75ad7135d119 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:01.113838 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-ea92164c-ff20-4253-ac90-75ad7135d119 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:01.127849 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.wsgi [None req-ea92164c-ff20-4253-ac90-75ad7135d119 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] HTTP exception thrown: Instance 0a122a08-bc0f-40fd-8139-74c9e8a70ebe could not be found. Oct 31 19:26:01.129518 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-ea92164c-ff20-4253-ac90-75ad7135d119 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Request method failure captured: Oct 31 19:26:01.129518 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: request: GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe HTTP/1.1 Oct 31 19:26:01.129518 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: Accept: application/json Oct 31 19:26:01.129518 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: Accept-Encoding: identity Oct 31 19:26:01.129518 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: Connection: close Oct 31 19:26:01.129518 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: Content-Length: 0 Oct 31 19:26:01.129518 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: Content-Type: application/json Oct 31 19:26:01.129518 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: Host: 10.222.0.16 Oct 31 19:26:01.129518 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: Openstack-System-Scope: None Oct 31 19:26:01.129518 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: User-Agent: python-urllib3/1.26.12 Oct 31 19:26:01.129518 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Auth-Token: gAAAAABjYCAU5m_sKvtIkeoaXuPr8CXsMHHRJ8qYn0L3UISbpKMC6Z0pOCalmS2pjJiljX1TpBfhLUcE-HOfnv7dP9YkqDtKxSUBmKV_wMMiYXUlgTEkuqkOCyE21_txON-vS2P_OXvwJTxbZwA1-_o3dYm0c9u4nAYGhkBYQU9y0qDg3NDN_14 Oct 31 19:26:01.129518 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Domain-Id: None Oct 31 19:26:01.129518 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Domain-Name: None Oct 31 19:26:01.129518 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Identity-Status: Confirmed Oct 31 19:26:01.129518 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Is-Admin-Project: True Oct 31 19:26:01.129518 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Project-Domain-Id: default Oct 31 19:26:01.129518 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Project-Domain-Name: Default Oct 31 19:26:01.129518 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Project-Id: 3f9c317b548b40deb8cb27236d36d674 Oct 31 19:26:01.129518 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Project-Name: tempest-AttachVolumeTestJSON-190527948 Oct 31 19:26:01.129518 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Role: member,reader Oct 31 19:26:01.129518 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Roles: member,reader Oct 31 19:26:01.131666 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3f9c317b548b40deb8cb27236d36d674"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3f9c317b548b40deb8cb27236d36d674", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3f9c317b548b40deb8cb27236d36d674"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3f9c317b548b40deb8cb27236d36d674"}]}] Oct 31 19:26:01.131666 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Tenant: tempest-AttachVolumeTestJSON-190527948 Oct 31 19:26:01.131666 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Tenant-Id: 3f9c317b548b40deb8cb27236d36d674 Oct 31 19:26:01.131666 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Tenant-Name: tempest-AttachVolumeTestJSON-190527948 Oct 31 19:26:01.131666 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-User: tempest-AttachVolumeTestJSON-190527948-project Oct 31 19:26:01.131666 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-User-Domain-Id: default Oct 31 19:26:01.131666 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-User-Domain-Name: Default Oct 31 19:26:01.131666 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-User-Id: ece6ca9374764214bac6263bd691bc4d Oct 31 19:26:01.131666 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-User-Name: tempest-AttachVolumeTestJSON-190527948-project Oct 31 19:26:01.131666 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: method: > Oct 31 19:26:01.131666 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: exception: Instance 0a122a08-bc0f-40fd-8139-74c9e8a70ebe could not be found. Oct 31 19:26:01.131666 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: action_args: {'id': '0a122a08-bc0f-40fd-8139-74c9e8a70ebe'} Oct 31 19:26:01.132607 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 19:26:01.132607 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:26:01.132607 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 19:26:01.132607 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 19:26:01.132607 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 19:26:01.132607 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 19:26:01.132607 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 19:26:01.132607 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 19:26:01.132607 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 19:26:01.132607 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 19:26:01.132607 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a122a08-bc0f-40fd-8139-74c9e8a70ebe could not be found. Oct 31 19:26:01.132607 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Oct 31 19:26:01.132607 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 19:26:01.132607 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Oct 31 19:26:01.132607 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:26:01.132607 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 19:26:01.132607 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 19:26:01.132607 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 19:26:01.132607 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 19:26:01.132607 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 19:26:01.133967 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 19:26:01.133967 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 19:26:01.133967 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 19:26:01.133967 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 19:26:01.133967 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 19:26:01.133967 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 19:26:01.133967 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 19:26:01.133967 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a122a08-bc0f-40fd-8139-74c9e8a70ebe could not be found. Oct 31 19:26:01.133967 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Oct 31 19:26:01.133967 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 19:26:01.133967 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Oct 31 19:26:01.133967 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:26:01.133967 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 19:26:01.133967 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 19:26:01.133967 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 19:26:01.133967 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 19:26:01.133967 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a122a08-bc0f-40fd-8139-74c9e8a70ebe could not be found. Oct 31 19:26:01.133967 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Oct 31 19:26:01.135069 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-ea92164c-ff20-4253-ac90-75ad7135d119 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Returning 404 to user: Instance 0a122a08-bc0f-40fd-8139-74c9e8a70ebe could not be found. {{(pid=118726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 19:26:01.135069 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-ea92164c-ff20-4253-ac90-75ad7135d119 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] 10.222.0.16 "GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe" status: 404 len: 111 microversion: 2.1 time: 0.031147 Oct 31 19:26:01.135069 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 330/660] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:26:01 2022] GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 19:26:01.140632 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-0f850eaa-a65d-43e1-b62a-768c83b21b8c tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Calling method '.version_select at 0x7f34f1f75ee0>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:26:01.158759 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-0f850eaa-a65d-43e1-b62a-768c83b21b8c tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-656109420" status: 202 len: 0 microversion: 2.1 time: 0.021898 Oct 31 19:26:01.159319 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 331/661] 10.222.0.16 () {58 vars in 1218 bytes} [Mon Oct 31 19:26:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-656109420 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 19:26:01.487907 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-c53fd270-9f2d-4353-b45c-01032116e402 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:26:01.488443 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-c53fd270-9f2d-4353-b45c-01032116e402 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] [instance: 95bfc882-6f9e-4736-9ee4-00f63c5892ff] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:26:01.494987 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-c53fd270-9f2d-4353-b45c-01032116e402 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:01.495470 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-c53fd270-9f2d-4353-b45c-01032116e402 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:01.495905 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-c53fd270-9f2d-4353-b45c-01032116e402 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:01.496604 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-c53fd270-9f2d-4353-b45c-01032116e402 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:01.497170 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-c53fd270-9f2d-4353-b45c-01032116e402 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:01.497597 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-c53fd270-9f2d-4353-b45c-01032116e402 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:01.632201 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-c53fd270-9f2d-4353-b45c-01032116e402 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbeda8236874f2ca69a6638c626e466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2956107c4664ccd8a7517a707982d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:01.639774 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-c53fd270-9f2d-4353-b45c-01032116e402 tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] 10.222.0.16 "GET /compute/v2.1/servers/95bfc882-6f9e-4736-9ee4-00f63c5892ff" status: 200 len: 1513 microversion: 2.1 time: 0.156266 Oct 31 19:26:01.640331 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 331/662] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:26:01 2022] GET /compute/v2.1/servers/95bfc882-6f9e-4736-9ee4-00f63c5892ff => generated 1513 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:26:01.758655 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-958d4036-452e-4a08-99fe-c2dea5d19fb9 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Action: 'create', calling method: .version_select at 0x7f34f1fcbd30>, body: {"keypair": {"name": "tempest-keypair-83270829", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPs5Fb2quIK53MuSm4nFwfJg5Q/UGI7b8d1YSPIjy7gIBibkGSxKc0O33E4EPw0eOmAZFJDgGWx/LLrKxWSsJsQi0Rw6P+b61Y5pC+tOKsv2ZBsNUaXnj0mn5mCdBRkCNA=="}} {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:26:01.775028 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.quota [None req-958d4036-452e-4a08-99fe-c2dea5d19fb9 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Getting quotas for project 3f9c317b548b40deb8cb27236d36d674. Resources: {'key_pairs'} {{(pid=118727) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 19:26:01.778981 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.quota [None req-958d4036-452e-4a08-99fe-c2dea5d19fb9 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Getting quotas for user ece6ca9374764214bac6263bd691bc4d and project 3f9c317b548b40deb8cb27236d36d674. Resources: {'key_pairs'} {{(pid=118727) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 19:26:01.803158 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-958d4036-452e-4a08-99fe-c2dea5d19fb9 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.049216 Oct 31 19:26:01.803751 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 332/663] 10.222.0.16 () {60 vars in 1159 bytes} [Mon Oct 31 19:26:01 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:26:02.020498 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-f7c7793e-e92f-4fc7-904f-7fa9fa009e8e tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:26:02.021777 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-f7c7793e-e92f-4fc7-904f-7fa9fa009e8e tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 3097dda0-1cb7-439c-b44a-898c488a6448] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:26:02.027882 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-f7c7793e-e92f-4fc7-904f-7fa9fa009e8e tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:02.028364 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-f7c7793e-e92f-4fc7-904f-7fa9fa009e8e tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:02.028794 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-f7c7793e-e92f-4fc7-904f-7fa9fa009e8e tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:02.029490 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-f7c7793e-e92f-4fc7-904f-7fa9fa009e8e tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:02.029963 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-f7c7793e-e92f-4fc7-904f-7fa9fa009e8e tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:02.030384 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-f7c7793e-e92f-4fc7-904f-7fa9fa009e8e tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:02.065532 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-f7c7793e-e92f-4fc7-904f-7fa9fa009e8e tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:02.066251 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-f7c7793e-e92f-4fc7-904f-7fa9fa009e8e tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:02.066789 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-f7c7793e-e92f-4fc7-904f-7fa9fa009e8e tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:02.067396 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.objects.instance [None req-f7c7793e-e92f-4fc7-904f-7fa9fa009e8e tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lazy-loading 'fault' on Instance uuid 3097dda0-1cb7-439c-b44a-898c488a6448 {{(pid=118726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 19:26:02.115312 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-f7c7793e-e92f-4fc7-904f-7fa9fa009e8e tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc49f9eb3114759b2889ed8972136d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cf63c76fc543428404002ae9a75b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:02.123584 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-f7c7793e-e92f-4fc7-904f-7fa9fa009e8e tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/3097dda0-1cb7-439c-b44a-898c488a6448" status: 200 len: 1336 microversion: 2.1 time: 0.107119 Oct 31 19:26:02.124161 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 332/664] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:26:02 2022] GET /compute/v2.1/servers/3097dda0-1cb7-439c-b44a-898c488a6448 => generated 1336 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:26:02.666375 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-c202bc00-92bf-4897-9599-56dd57a4490f tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:26:02.666375 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-c202bc00-92bf-4897-9599-56dd57a4490f tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] [instance: 95bfc882-6f9e-4736-9ee4-00f63c5892ff] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:26:02.671862 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-c202bc00-92bf-4897-9599-56dd57a4490f tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:02.672755 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-c202bc00-92bf-4897-9599-56dd57a4490f tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:02.673416 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-c202bc00-92bf-4897-9599-56dd57a4490f tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:02.674658 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-c202bc00-92bf-4897-9599-56dd57a4490f tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:02.675300 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-c202bc00-92bf-4897-9599-56dd57a4490f tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:02.675834 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-c202bc00-92bf-4897-9599-56dd57a4490f tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:02.995913 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-c202bc00-92bf-4897-9599-56dd57a4490f tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbeda8236874f2ca69a6638c626e466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2956107c4664ccd8a7517a707982d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:03.003967 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-c202bc00-92bf-4897-9599-56dd57a4490f tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] 10.222.0.16 "GET /compute/v2.1/servers/95bfc882-6f9e-4736-9ee4-00f63c5892ff" status: 200 len: 1513 microversion: 2.1 time: 0.345519 Oct 31 19:26:03.011640 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 333/665] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:26:02 2022] GET /compute/v2.1/servers/95bfc882-6f9e-4736-9ee4-00f63c5892ff => generated 1513 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:26:03.087626 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [req-c23981a2-da11-43a5-8848-77533f7edd9e req-e82c6192-62be-40ba-9564-2166c2281869 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95bfc882-6f9e-4736-9ee4-00f63c5892ff", "name": "network-vif-deleted", "tag": "893175ba-959f-42bd-a1b8-f25e42226117"}]} {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:26:03.099880 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [req-c23981a2-da11-43a5-8848-77533f7edd9e req-e82c6192-62be-40ba-9564-2166c2281869 service nova] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:03.100650 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [req-c23981a2-da11-43a5-8848-77533f7edd9e req-e82c6192-62be-40ba-9564-2166c2281869 service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:03.101278 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [req-c23981a2-da11-43a5-8848-77533f7edd9e req-e82c6192-62be-40ba-9564-2166c2281869 service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:03.115739 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.compute.server_external_events [req-c23981a2-da11-43a5-8848-77533f7edd9e req-e82c6192-62be-40ba-9564-2166c2281869 service nova] Creating event network-vif-deleted:893175ba-959f-42bd-a1b8-f25e42226117 for instance 95bfc882-6f9e-4736-9ee4-00f63c5892ff on hv-cinder-86309 Oct 31 19:26:03.121660 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [req-c23981a2-da11-43a5-8848-77533f7edd9e req-e82c6192-62be-40ba-9564-2166c2281869 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038562 Oct 31 19:26:03.122335 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 333/666] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 31 19:26:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 19:26:03.148298 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-eb3a491b-381f-4819-bc16-8a7f8a60f2f4 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:26:03.149177 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-eb3a491b-381f-4819-bc16-8a7f8a60f2f4 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 3097dda0-1cb7-439c-b44a-898c488a6448] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:26:03.155316 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-eb3a491b-381f-4819-bc16-8a7f8a60f2f4 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:03.155805 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-eb3a491b-381f-4819-bc16-8a7f8a60f2f4 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:03.156244 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-eb3a491b-381f-4819-bc16-8a7f8a60f2f4 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:03.156944 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-eb3a491b-381f-4819-bc16-8a7f8a60f2f4 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:03.157402 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-eb3a491b-381f-4819-bc16-8a7f8a60f2f4 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:03.158073 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-eb3a491b-381f-4819-bc16-8a7f8a60f2f4 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:03.173703 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.wsgi [None req-eb3a491b-381f-4819-bc16-8a7f8a60f2f4 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] HTTP exception thrown: Instance 3097dda0-1cb7-439c-b44a-898c488a6448 could not be found. Oct 31 19:26:03.175387 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-eb3a491b-381f-4819-bc16-8a7f8a60f2f4 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Request method failure captured: Oct 31 19:26:03.175387 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: request: GET /compute/v2.1/servers/3097dda0-1cb7-439c-b44a-898c488a6448 HTTP/1.1 Oct 31 19:26:03.175387 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Accept: application/json Oct 31 19:26:03.175387 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Accept-Encoding: identity Oct 31 19:26:03.175387 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Connection: close Oct 31 19:26:03.175387 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Content-Length: 0 Oct 31 19:26:03.175387 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Content-Type: application/json Oct 31 19:26:03.175387 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Host: 10.222.0.16 Oct 31 19:26:03.175387 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Openstack-System-Scope: None Oct 31 19:26:03.175387 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: User-Agent: python-urllib3/1.26.12 Oct 31 19:26:03.175387 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Auth-Token: gAAAAABjYCAUQ8YIOE1LqUgdd-VNJVSMmtJLqLbK8GSGQuylkQibi1W0G15Xlmc42Ab2ILvZHAFaOwUXTuxHL77kGeaOPHnfv7wa7hvLMGAh1mz7JFprCgygCLONv8fHZR7cWDh7VdBpvVSZYSPSFRHB1FTdSs8ZWKVZbGgsG6vqf9BFw1oXMP8 Oct 31 19:26:03.175387 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Domain-Id: None Oct 31 19:26:03.175387 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Domain-Name: None Oct 31 19:26:03.175387 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Identity-Status: Confirmed Oct 31 19:26:03.175387 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Is-Admin-Project: True Oct 31 19:26:03.175387 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Project-Domain-Id: default Oct 31 19:26:03.175387 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Project-Domain-Name: Default Oct 31 19:26:03.175387 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Project-Id: 73cf63c76fc543428404002ae9a75b29 Oct 31 19:26:03.175387 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-466281787 Oct 31 19:26:03.175387 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Role: member,reader Oct 31 19:26:03.175387 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Roles: member,reader Oct 31 19:26:03.177511 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/73cf63c76fc543428404002ae9a75b29"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_73cf63c76fc543428404002ae9a75b29", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/73cf63c76fc543428404002ae9a75b29"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/73cf63c76fc543428404002ae9a75b29"}]}] Oct 31 19:26:03.177511 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Tenant: tempest-ServerRescueNegativeTestJSON-466281787 Oct 31 19:26:03.177511 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Tenant-Id: 73cf63c76fc543428404002ae9a75b29 Oct 31 19:26:03.177511 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-466281787 Oct 31 19:26:03.177511 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User: tempest-ServerRescueNegativeTestJSON-466281787-project Oct 31 19:26:03.177511 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User-Domain-Id: default Oct 31 19:26:03.177511 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User-Domain-Name: Default Oct 31 19:26:03.177511 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User-Id: ddc49f9eb3114759b2889ed8972136d8 Oct 31 19:26:03.177511 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User-Name: tempest-ServerRescueNegativeTestJSON-466281787-project Oct 31 19:26:03.177511 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: method: > Oct 31 19:26:03.177511 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: exception: Instance 3097dda0-1cb7-439c-b44a-898c488a6448 could not be found. Oct 31 19:26:03.177511 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: action_args: {'id': '3097dda0-1cb7-439c-b44a-898c488a6448'} Oct 31 19:26:03.179235 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 19:26:03.179235 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:26:03.179235 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 19:26:03.179235 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 19:26:03.179235 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 19:26:03.179235 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 19:26:03.179235 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 19:26:03.179235 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 19:26:03.179235 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 19:26:03.179235 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 19:26:03.179235 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3097dda0-1cb7-439c-b44a-898c488a6448 could not be found. Oct 31 19:26:03.179235 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:26:03.179235 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 19:26:03.179235 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:26:03.179235 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:26:03.179235 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 19:26:03.179235 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 19:26:03.179235 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 19:26:03.179235 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 19:26:03.179235 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 19:26:03.181414 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 19:26:03.181414 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 19:26:03.181414 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 19:26:03.181414 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 19:26:03.181414 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 19:26:03.181414 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 19:26:03.181414 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 19:26:03.181414 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3097dda0-1cb7-439c-b44a-898c488a6448 could not be found. Oct 31 19:26:03.181414 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:26:03.181414 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 19:26:03.181414 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:26:03.181414 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:26:03.181414 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 19:26:03.181414 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 19:26:03.181414 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 19:26:03.181414 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 19:26:03.181414 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3097dda0-1cb7-439c-b44a-898c488a6448 could not be found. Oct 31 19:26:03.181414 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:26:03.182815 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-eb3a491b-381f-4819-bc16-8a7f8a60f2f4 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Returning 404 to user: Instance 3097dda0-1cb7-439c-b44a-898c488a6448 could not be found. {{(pid=118727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 19:26:03.182815 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-eb3a491b-381f-4819-bc16-8a7f8a60f2f4 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/3097dda0-1cb7-439c-b44a-898c488a6448" status: 404 len: 111 microversion: 2.1 time: 0.032341 Oct 31 19:26:03.182815 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 334/667] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:26:03 2022] GET /compute/v2.1/servers/3097dda0-1cb7-439c-b44a-898c488a6448 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 19:26:03.186778 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-36c2f045-bc04-4640-832f-40d240dbaad8 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '.version_select at 0x7f34f1f1a1f0>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:26:03.191420 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR oslo.messaging._drivers.impl_rabbit [None req-36c2f045-bc04-4640-832f-40d240dbaad8 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [87e42b1b-ac78-4134-bf32-1a7292762e9b] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 31 19:26:03.650821 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-d123e8ae-cb9b-4962-9f12-f286ef70b447 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-462376989", "imageRef": "a9795ee0-6722-4e1e-8fc8-a6c2e68f3049", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bb81951e-1ade-402e-8059-76bd3e08139a"}], "security_groups": [{"name": "tempest-securitygroup--722587428"}], "key_name": "tempest-keypair-83270829", "user_data": "}} {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:26:03.754011 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.network.neutron [None req-d123e8ae-cb9b-4962-9f12-f286ef70b447 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] validate_networks() for [('bb81951e-1ade-402e-8059-76bd3e08139a', None, None, None, None, None)] {{(pid=118727) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 19:26:04.170126 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.virt.hardware [None req-d123e8ae-cb9b-4962-9f12-f286ef70b447 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Flavor limits 0:0:0 {{(pid=118727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 19:26:04.170555 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.virt.hardware [None req-d123e8ae-cb9b-4962-9f12-f286ef70b447 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Image limits 0:0:0 {{(pid=118727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 19:26:04.171029 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.virt.hardware [None req-d123e8ae-cb9b-4962-9f12-f286ef70b447 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Flavor pref 0:0:0 {{(pid=118727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 19:26:04.171439 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.virt.hardware [None req-d123e8ae-cb9b-4962-9f12-f286ef70b447 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Image pref 0:0:0 {{(pid=118727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 19:26:04.171882 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.virt.hardware [None req-d123e8ae-cb9b-4962-9f12-f286ef70b447 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 19:26:04.181258 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-d123e8ae-cb9b-4962-9f12-f286ef70b447 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:04.181774 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-d123e8ae-cb9b-4962-9f12-f286ef70b447 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:04.182220 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-d123e8ae-cb9b-4962-9f12-f286ef70b447 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:04.182946 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-d123e8ae-cb9b-4962-9f12-f286ef70b447 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:04.183403 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-d123e8ae-cb9b-4962-9f12-f286ef70b447 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:04.183827 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-d123e8ae-cb9b-4962-9f12-f286ef70b447 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:04.200080 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO oslo.messaging._drivers.impl_rabbit [None req-36c2f045-bc04-4640-832f-40d240dbaad8 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [87e42b1b-ac78-4134-bf32-1a7292762e9b] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 50856. Oct 31 19:26:04.200564 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.quota [None req-d123e8ae-cb9b-4962-9f12-f286ef70b447 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Getting quotas for project 3f9c317b548b40deb8cb27236d36d674. Resources: {'instances', 'ram', 'cores'} {{(pid=118727) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 19:26:04.204507 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.quota [None req-d123e8ae-cb9b-4962-9f12-f286ef70b447 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Getting quotas for user ece6ca9374764214bac6263bd691bc4d and project 3f9c317b548b40deb8cb27236d36d674. Resources: {'instances', 'ram', 'cores'} {{(pid=118727) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 19:26:04.217215 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-d123e8ae-cb9b-4962-9f12-f286ef70b447 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Going to run 1 instances... {{(pid=118727) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 19:26:04.219558 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-d123e8ae-cb9b-4962-9f12-f286ef70b447 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] [instance: c96bdeca-16e0-4d90-a9f9-0f9d46799d68] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9795ee0-6722-4e1e-8fc8-a6c2e68f3049',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118727) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 19:26:04.221131 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-36c2f045-bc04-4640-832f-40d240dbaad8 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1462207282" status: 202 len: 0 microversion: 2.1 time: 1.038660 Oct 31 19:26:04.221771 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 334/668] 10.222.0.16 () {58 vars in 1221 bytes} [Mon Oct 31 19:26:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1462207282 => generated 0 bytes in 1040 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 31 19:26:04.228455 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-08e8f6a1-d0d0-4658-a5c0-5703a01b6536 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:26:04.229153 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-08e8f6a1-d0d0-4658-a5c0-5703a01b6536 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] [instance: fb16e6d4-57d8-4185-9955-ec1d261b365d] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:26:04.238938 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-08e8f6a1-d0d0-4658-a5c0-5703a01b6536 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:04.239430 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-08e8f6a1-d0d0-4658-a5c0-5703a01b6536 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:04.239864 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-08e8f6a1-d0d0-4658-a5c0-5703a01b6536 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:04.240579 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-08e8f6a1-d0d0-4658-a5c0-5703a01b6536 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:04.241029 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-08e8f6a1-d0d0-4658-a5c0-5703a01b6536 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:04.241687 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-08e8f6a1-d0d0-4658-a5c0-5703a01b6536 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:04.267725 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.objects.instance [None req-08e8f6a1-d0d0-4658-a5c0-5703a01b6536 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lazy-loading 'flavor' on Instance uuid fb16e6d4-57d8-4185-9955-ec1d261b365d {{(pid=118726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 19:26:04.270902 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-d123e8ae-cb9b-4962-9f12-f286ef70b447 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.624194 Oct 31 19:26:04.277554 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 335/669] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 31 19:26:03 2022] POST /compute/v2.1/servers => generated 401 bytes in 626 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 31 19:26:04.277554 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-e61373ea-1712-4112-bab5-adb5a356b1fe tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:26:04.277554 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-e61373ea-1712-4112-bab5-adb5a356b1fe tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] [instance: 95bfc882-6f9e-4736-9ee4-00f63c5892ff] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:26:04.284274 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-e61373ea-1712-4112-bab5-adb5a356b1fe tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:04.284762 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-e61373ea-1712-4112-bab5-adb5a356b1fe tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:04.285202 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-e61373ea-1712-4112-bab5-adb5a356b1fe tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:04.285927 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-e61373ea-1712-4112-bab5-adb5a356b1fe tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:04.286917 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-e61373ea-1712-4112-bab5-adb5a356b1fe tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:04.287341 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-e61373ea-1712-4112-bab5-adb5a356b1fe tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:04.312513 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.wsgi [None req-e61373ea-1712-4112-bab5-adb5a356b1fe tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] HTTP exception thrown: Instance 95bfc882-6f9e-4736-9ee4-00f63c5892ff could not be found. Oct 31 19:26:04.314103 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-e61373ea-1712-4112-bab5-adb5a356b1fe tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Request method failure captured: Oct 31 19:26:04.314103 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: request: GET /compute/v2.1/servers/95bfc882-6f9e-4736-9ee4-00f63c5892ff HTTP/1.1 Oct 31 19:26:04.314103 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Accept: application/json Oct 31 19:26:04.314103 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Accept-Encoding: identity Oct 31 19:26:04.314103 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Connection: close Oct 31 19:26:04.314103 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Content-Length: 0 Oct 31 19:26:04.314103 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Content-Type: application/json Oct 31 19:26:04.314103 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Host: 10.222.0.16 Oct 31 19:26:04.314103 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Openstack-System-Scope: None Oct 31 19:26:04.314103 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: User-Agent: python-urllib3/1.26.12 Oct 31 19:26:04.314103 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Auth-Token: gAAAAABjYCDZBRm5IAtu52n2A1IC2mBLutWSQ5rRBmCcW9NmnZDh8WSMlq-t1TP-nICDvSoE-YzrYBDamZtRCrVmbWEyKJzqF2wP0d2gw7KVlgKawzN0OkwUUjO2BbjkOUh7CBDrDQufKeQag6ADsH5jSBhJDTnrWVNtxgH6pkrmE58zzRiILoU Oct 31 19:26:04.314103 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Domain-Id: None Oct 31 19:26:04.314103 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Domain-Name: None Oct 31 19:26:04.314103 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Identity-Status: Confirmed Oct 31 19:26:04.314103 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Is-Admin-Project: True Oct 31 19:26:04.314103 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Project-Domain-Id: default Oct 31 19:26:04.314103 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Project-Domain-Name: Default Oct 31 19:26:04.314103 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Project-Id: b2956107c4664ccd8a7517a707982d1b Oct 31 19:26:04.314103 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1361638688 Oct 31 19:26:04.314103 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Role: member,reader Oct 31 19:26:04.314103 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Roles: member,reader Oct 31 19:26:04.315669 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b2956107c4664ccd8a7517a707982d1b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b2956107c4664ccd8a7517a707982d1b", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b2956107c4664ccd8a7517a707982d1b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b2956107c4664ccd8a7517a707982d1b"}]}] Oct 31 19:26:04.315669 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Tenant: tempest-VolumesSnapshotTestJSON-1361638688 Oct 31 19:26:04.315669 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Tenant-Id: b2956107c4664ccd8a7517a707982d1b Oct 31 19:26:04.315669 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1361638688 Oct 31 19:26:04.315669 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User: tempest-VolumesSnapshotTestJSON-1361638688-project Oct 31 19:26:04.315669 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User-Domain-Id: default Oct 31 19:26:04.315669 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User-Domain-Name: Default Oct 31 19:26:04.315669 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User-Id: 5cbeda8236874f2ca69a6638c626e466 Oct 31 19:26:04.315669 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User-Name: tempest-VolumesSnapshotTestJSON-1361638688-project Oct 31 19:26:04.315669 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: method: > Oct 31 19:26:04.315669 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: exception: Instance 95bfc882-6f9e-4736-9ee4-00f63c5892ff could not be found. Oct 31 19:26:04.315669 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: action_args: {'id': '95bfc882-6f9e-4736-9ee4-00f63c5892ff'} Oct 31 19:26:04.320638 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 19:26:04.320638 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:26:04.320638 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 19:26:04.320638 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 19:26:04.320638 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 19:26:04.320638 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 19:26:04.320638 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 19:26:04.320638 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 19:26:04.320638 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 19:26:04.320638 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 19:26:04.320638 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95bfc882-6f9e-4736-9ee4-00f63c5892ff could not be found. Oct 31 19:26:04.320638 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:26:04.320638 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 19:26:04.320638 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:26:04.320638 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:26:04.320638 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 19:26:04.320638 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 19:26:04.320638 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 19:26:04.320638 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 19:26:04.320638 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 19:26:04.322345 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 19:26:04.322345 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 19:26:04.322345 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 19:26:04.322345 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 19:26:04.322345 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 19:26:04.322345 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 19:26:04.322345 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 19:26:04.322345 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95bfc882-6f9e-4736-9ee4-00f63c5892ff could not be found. Oct 31 19:26:04.322345 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:26:04.322345 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 19:26:04.322345 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:26:04.322345 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:26:04.322345 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 19:26:04.322345 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 19:26:04.322345 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 19:26:04.322345 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 19:26:04.322345 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95bfc882-6f9e-4736-9ee4-00f63c5892ff could not be found. Oct 31 19:26:04.322345 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:26:04.323691 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-e61373ea-1712-4112-bab5-adb5a356b1fe tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] Returning 404 to user: Instance 95bfc882-6f9e-4736-9ee4-00f63c5892ff could not be found. {{(pid=118727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 19:26:04.323691 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-e61373ea-1712-4112-bab5-adb5a356b1fe tempest-VolumesSnapshotTestJSON-1361638688 tempest-VolumesSnapshotTestJSON-1361638688-project] 10.222.0.16 "GET /compute/v2.1/servers/95bfc882-6f9e-4736-9ee4-00f63c5892ff" status: 404 len: 111 microversion: 2.1 time: 0.042709 Oct 31 19:26:04.323691 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 336/670] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:26:04 2022] GET /compute/v2.1/servers/95bfc882-6f9e-4736-9ee4-00f63c5892ff => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 19:26:04.326387 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-32ec7de9-9b84-4985-9663-8542dcfbe9ce tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:26:04.327020 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-32ec7de9-9b84-4985-9663-8542dcfbe9ce tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] [instance: c96bdeca-16e0-4d90-a9f9-0f9d46799d68] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:26:04.400764 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-08e8f6a1-d0d0-4658-a5c0-5703a01b6536 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] 10.222.0.16 "POST /compute/v2.1/servers/fb16e6d4-57d8-4185-9955-ec1d261b365d/action" status: 202 len: 0 microversion: 2.1 time: 0.177729 Oct 31 19:26:04.404792 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 335/671] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 31 19:26:04 2022] POST /compute/v2.1/servers/fb16e6d4-57d8-4185-9955-ec1d261b365d/action => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 19:26:04.410321 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-9ea9f763-2bfd-4f47-a633-75f7b670b17e tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:26:04.411286 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-9ea9f763-2bfd-4f47-a633-75f7b670b17e tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] [instance: fb16e6d4-57d8-4185-9955-ec1d261b365d] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:26:04.418111 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-9ea9f763-2bfd-4f47-a633-75f7b670b17e tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:04.418795 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-9ea9f763-2bfd-4f47-a633-75f7b670b17e tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:04.419404 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-9ea9f763-2bfd-4f47-a633-75f7b670b17e tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:04.420095 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-9ea9f763-2bfd-4f47-a633-75f7b670b17e tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:04.420798 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-9ea9f763-2bfd-4f47-a633-75f7b670b17e tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:04.421376 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-9ea9f763-2bfd-4f47-a633-75f7b670b17e tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:04.450811 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-32ec7de9-9b84-4985-9663-8542dcfbe9ce tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ece6ca9374764214bac6263bd691bc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9c317b548b40deb8cb27236d36d674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:04.465975 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-32ec7de9-9b84-4985-9663-8542dcfbe9ce tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] 10.222.0.16 "GET /compute/v2.1/servers/c96bdeca-16e0-4d90-a9f9-0f9d46799d68" status: 200 len: 1235 microversion: 2.1 time: 0.147089 Oct 31 19:26:04.466559 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 337/672] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:26:04 2022] GET /compute/v2.1/servers/c96bdeca-16e0-4d90-a9f9-0f9d46799d68 => generated 1235 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:26:04.666198 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-9ea9f763-2bfd-4f47-a633-75f7b670b17e tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5cfee7994ab404d974d86d77e075209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33bb29688304d0dae3cfdc0eb54b7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:04.676483 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-9ea9f763-2bfd-4f47-a633-75f7b670b17e tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] 10.222.0.16 "GET /compute/v2.1/servers/fb16e6d4-57d8-4185-9955-ec1d261b365d" status: 200 len: 1568 microversion: 2.1 time: 0.270199 Oct 31 19:26:04.678498 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 336/673] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:26:04 2022] GET /compute/v2.1/servers/fb16e6d4-57d8-4185-9955-ec1d261b365d => generated 1568 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:26:05.489344 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-9df5694d-97b9-4250-ab1c-13b8b8ad7e49 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:26:05.489966 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-9df5694d-97b9-4250-ab1c-13b8b8ad7e49 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] [instance: c96bdeca-16e0-4d90-a9f9-0f9d46799d68] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:26:05.496889 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-9df5694d-97b9-4250-ab1c-13b8b8ad7e49 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:05.497369 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-9df5694d-97b9-4250-ab1c-13b8b8ad7e49 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:05.497834 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-9df5694d-97b9-4250-ab1c-13b8b8ad7e49 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:05.498519 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-9df5694d-97b9-4250-ab1c-13b8b8ad7e49 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:05.498967 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-9df5694d-97b9-4250-ab1c-13b8b8ad7e49 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:05.499389 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-9df5694d-97b9-4250-ab1c-13b8b8ad7e49 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:05.561842 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-9df5694d-97b9-4250-ab1c-13b8b8ad7e49 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ece6ca9374764214bac6263bd691bc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9c317b548b40deb8cb27236d36d674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:05.569254 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-9df5694d-97b9-4250-ab1c-13b8b8ad7e49 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] 10.222.0.16 "GET /compute/v2.1/servers/c96bdeca-16e0-4d90-a9f9-0f9d46799d68" status: 200 len: 1287 microversion: 2.1 time: 0.084415 Oct 31 19:26:05.569858 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 338/674] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:26:05 2022] GET /compute/v2.1/servers/c96bdeca-16e0-4d90-a9f9-0f9d46799d68 => generated 1287 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:26:05.700588 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-b0a81177-2bd1-4291-8d2b-dd9fefea244d tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:26:05.701207 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-b0a81177-2bd1-4291-8d2b-dd9fefea244d tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] [instance: fb16e6d4-57d8-4185-9955-ec1d261b365d] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:26:05.709803 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-b0a81177-2bd1-4291-8d2b-dd9fefea244d tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:05.710296 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-b0a81177-2bd1-4291-8d2b-dd9fefea244d tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:05.710733 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-b0a81177-2bd1-4291-8d2b-dd9fefea244d tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:05.711432 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-b0a81177-2bd1-4291-8d2b-dd9fefea244d tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:05.711891 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-b0a81177-2bd1-4291-8d2b-dd9fefea244d tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:05.712315 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-b0a81177-2bd1-4291-8d2b-dd9fefea244d tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:05.873437 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-b0a81177-2bd1-4291-8d2b-dd9fefea244d tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5cfee7994ab404d974d86d77e075209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33bb29688304d0dae3cfdc0eb54b7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:05.884369 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-b0a81177-2bd1-4291-8d2b-dd9fefea244d tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] 10.222.0.16 "GET /compute/v2.1/servers/fb16e6d4-57d8-4185-9955-ec1d261b365d" status: 200 len: 1568 microversion: 2.1 time: 0.187546 Oct 31 19:26:05.885739 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 337/675] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:26:05 2022] GET /compute/v2.1/servers/fb16e6d4-57d8-4185-9955-ec1d261b365d => generated 1568 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:26:06.592737 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-f40af8d3-cb10-45d2-a985-c1f3c3e921a4 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:26:06.593446 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-f40af8d3-cb10-45d2-a985-c1f3c3e921a4 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] [instance: c96bdeca-16e0-4d90-a9f9-0f9d46799d68] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:26:06.596045 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG dbcounter [-] [118727] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=118727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:26:06.601542 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-f40af8d3-cb10-45d2-a985-c1f3c3e921a4 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:06.602053 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-f40af8d3-cb10-45d2-a985-c1f3c3e921a4 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:06.602485 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-f40af8d3-cb10-45d2-a985-c1f3c3e921a4 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:06.603178 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-f40af8d3-cb10-45d2-a985-c1f3c3e921a4 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:06.603628 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-f40af8d3-cb10-45d2-a985-c1f3c3e921a4 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:06.604043 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-f40af8d3-cb10-45d2-a985-c1f3c3e921a4 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:06.742528 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-f40af8d3-cb10-45d2-a985-c1f3c3e921a4 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ece6ca9374764214bac6263bd691bc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9c317b548b40deb8cb27236d36d674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:06.750246 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-f40af8d3-cb10-45d2-a985-c1f3c3e921a4 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] 10.222.0.16 "GET /compute/v2.1/servers/c96bdeca-16e0-4d90-a9f9-0f9d46799d68" status: 200 len: 1360 microversion: 2.1 time: 0.161421 Oct 31 19:26:06.751113 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 339/676] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:26:06 2022] GET /compute/v2.1/servers/c96bdeca-16e0-4d90-a9f9-0f9d46799d68 => generated 1360 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:26:06.913557 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-f0a9c8cb-c0a0-48a9-9412-087dad8bd9fc tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:26:06.914122 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-f0a9c8cb-c0a0-48a9-9412-087dad8bd9fc tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] [instance: fb16e6d4-57d8-4185-9955-ec1d261b365d] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:26:06.920674 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-f0a9c8cb-c0a0-48a9-9412-087dad8bd9fc tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:06.921173 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-f0a9c8cb-c0a0-48a9-9412-087dad8bd9fc tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:06.921623 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-f0a9c8cb-c0a0-48a9-9412-087dad8bd9fc tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:06.922292 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-f0a9c8cb-c0a0-48a9-9412-087dad8bd9fc tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:06.922747 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-f0a9c8cb-c0a0-48a9-9412-087dad8bd9fc tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:06.923163 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-f0a9c8cb-c0a0-48a9-9412-087dad8bd9fc tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:07.051635 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-f0a9c8cb-c0a0-48a9-9412-087dad8bd9fc tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5cfee7994ab404d974d86d77e075209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33bb29688304d0dae3cfdc0eb54b7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:07.059743 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-f0a9c8cb-c0a0-48a9-9412-087dad8bd9fc tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] 10.222.0.16 "GET /compute/v2.1/servers/fb16e6d4-57d8-4185-9955-ec1d261b365d" status: 200 len: 1568 microversion: 2.1 time: 0.150096 Oct 31 19:26:07.060299 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 338/677] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:26:06 2022] GET /compute/v2.1/servers/fb16e6d4-57d8-4185-9955-ec1d261b365d => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:26:07.774460 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-9e4cd8f2-2e90-4dcf-a2a8-7b5915a6c4b4 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:26:07.775094 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-9e4cd8f2-2e90-4dcf-a2a8-7b5915a6c4b4 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] [instance: c96bdeca-16e0-4d90-a9f9-0f9d46799d68] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:26:07.781438 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-9e4cd8f2-2e90-4dcf-a2a8-7b5915a6c4b4 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:07.781964 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-9e4cd8f2-2e90-4dcf-a2a8-7b5915a6c4b4 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:07.782401 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-9e4cd8f2-2e90-4dcf-a2a8-7b5915a6c4b4 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:07.783095 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-9e4cd8f2-2e90-4dcf-a2a8-7b5915a6c4b4 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:07.783549 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-9e4cd8f2-2e90-4dcf-a2a8-7b5915a6c4b4 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:07.783977 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-9e4cd8f2-2e90-4dcf-a2a8-7b5915a6c4b4 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:07.915187 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-9e4cd8f2-2e90-4dcf-a2a8-7b5915a6c4b4 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ece6ca9374764214bac6263bd691bc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9c317b548b40deb8cb27236d36d674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:07.922996 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-9e4cd8f2-2e90-4dcf-a2a8-7b5915a6c4b4 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] 10.222.0.16 "GET /compute/v2.1/servers/c96bdeca-16e0-4d90-a9f9-0f9d46799d68" status: 200 len: 1360 microversion: 2.1 time: 0.152966 Oct 31 19:26:07.923553 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 340/678] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:26:07 2022] GET /compute/v2.1/servers/c96bdeca-16e0-4d90-a9f9-0f9d46799d68 => generated 1360 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:26:08.082930 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-ad0a49aa-9793-4fc6-bf83-5c6b3b5551d3 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:26:08.084172 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-ad0a49aa-9793-4fc6-bf83-5c6b3b5551d3 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] [instance: fb16e6d4-57d8-4185-9955-ec1d261b365d] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:26:08.090481 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-ad0a49aa-9793-4fc6-bf83-5c6b3b5551d3 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:08.090955 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-ad0a49aa-9793-4fc6-bf83-5c6b3b5551d3 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:08.091384 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-ad0a49aa-9793-4fc6-bf83-5c6b3b5551d3 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:08.092068 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-ad0a49aa-9793-4fc6-bf83-5c6b3b5551d3 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:08.092519 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-ad0a49aa-9793-4fc6-bf83-5c6b3b5551d3 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:08.092941 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-ad0a49aa-9793-4fc6-bf83-5c6b3b5551d3 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:08.221819 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-ad0a49aa-9793-4fc6-bf83-5c6b3b5551d3 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5cfee7994ab404d974d86d77e075209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33bb29688304d0dae3cfdc0eb54b7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:08.230026 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-ad0a49aa-9793-4fc6-bf83-5c6b3b5551d3 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] 10.222.0.16 "GET /compute/v2.1/servers/fb16e6d4-57d8-4185-9955-ec1d261b365d" status: 200 len: 1568 microversion: 2.1 time: 0.150889 Oct 31 19:26:08.230598 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 339/679] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:26:08 2022] GET /compute/v2.1/servers/fb16e6d4-57d8-4185-9955-ec1d261b365d => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:26:08.528503 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [req-c4c60bcb-e189-4158-91b1-96a021aa3a76 req-6f081049-0ef4-4737-97ee-64d229a36343 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c96bdeca-16e0-4d90-a9f9-0f9d46799d68", "tag": "6abee1f4-a65e-4f4f-9235-4bfd378d8389"}]} {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:26:08.538940 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [req-c4c60bcb-e189-4158-91b1-96a021aa3a76 req-6f081049-0ef4-4737-97ee-64d229a36343 service nova] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:08.539421 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [req-c4c60bcb-e189-4158-91b1-96a021aa3a76 req-6f081049-0ef4-4737-97ee-64d229a36343 service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:08.539853 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [req-c4c60bcb-e189-4158-91b1-96a021aa3a76 req-6f081049-0ef4-4737-97ee-64d229a36343 service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:08.550767 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.compute.server_external_events [req-c4c60bcb-e189-4158-91b1-96a021aa3a76 req-6f081049-0ef4-4737-97ee-64d229a36343 service nova] Creating event network-changed:6abee1f4-a65e-4f4f-9235-4bfd378d8389 for instance c96bdeca-16e0-4d90-a9f9-0f9d46799d68 on hv-cinder-86309 Oct 31 19:26:08.555770 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [req-c4c60bcb-e189-4158-91b1-96a021aa3a76 req-6f081049-0ef4-4737-97ee-64d229a36343 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031007 Oct 31 19:26:08.556297 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 341/680] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 31 19:26:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:26:08.945746 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-015a96fa-ae51-4400-8c74-ea3557ef0842 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:26:08.946355 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-015a96fa-ae51-4400-8c74-ea3557ef0842 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] [instance: c96bdeca-16e0-4d90-a9f9-0f9d46799d68] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:26:08.952601 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-015a96fa-ae51-4400-8c74-ea3557ef0842 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:08.953087 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-015a96fa-ae51-4400-8c74-ea3557ef0842 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:08.953522 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-015a96fa-ae51-4400-8c74-ea3557ef0842 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:08.954265 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-015a96fa-ae51-4400-8c74-ea3557ef0842 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:08.954721 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-015a96fa-ae51-4400-8c74-ea3557ef0842 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:08.955145 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-015a96fa-ae51-4400-8c74-ea3557ef0842 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:09.091532 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-015a96fa-ae51-4400-8c74-ea3557ef0842 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ece6ca9374764214bac6263bd691bc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9c317b548b40deb8cb27236d36d674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:09.110729 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-015a96fa-ae51-4400-8c74-ea3557ef0842 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] 10.222.0.16 "GET /compute/v2.1/servers/c96bdeca-16e0-4d90-a9f9-0f9d46799d68" status: 200 len: 1360 microversion: 2.1 time: 0.169368 Oct 31 19:26:09.112014 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 340/681] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:26:08 2022] GET /compute/v2.1/servers/c96bdeca-16e0-4d90-a9f9-0f9d46799d68 => generated 1360 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:26:09.255626 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-03ac3833-1c51-42a9-a5f8-9cc133ed5a48 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:26:09.256345 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-03ac3833-1c51-42a9-a5f8-9cc133ed5a48 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] [instance: fb16e6d4-57d8-4185-9955-ec1d261b365d] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:26:09.263029 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-03ac3833-1c51-42a9-a5f8-9cc133ed5a48 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:09.263600 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-03ac3833-1c51-42a9-a5f8-9cc133ed5a48 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:09.264161 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-03ac3833-1c51-42a9-a5f8-9cc133ed5a48 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:09.265121 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-03ac3833-1c51-42a9-a5f8-9cc133ed5a48 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:09.265733 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-03ac3833-1c51-42a9-a5f8-9cc133ed5a48 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:09.266262 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-03ac3833-1c51-42a9-a5f8-9cc133ed5a48 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:09.408175 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-f27664f5-ebf3-4110-9c38-7b95f006876c tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:26:09.408838 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-f27664f5-ebf3-4110-9c38-7b95f006876c tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 37698c73-94da-4904-a8d5-636936092fba] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:26:09.418483 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-f27664f5-ebf3-4110-9c38-7b95f006876c tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:09.419036 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-f27664f5-ebf3-4110-9c38-7b95f006876c tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:09.419534 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-f27664f5-ebf3-4110-9c38-7b95f006876c tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:09.420460 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-f27664f5-ebf3-4110-9c38-7b95f006876c tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:09.421158 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-f27664f5-ebf3-4110-9c38-7b95f006876c tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:09.421664 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-f27664f5-ebf3-4110-9c38-7b95f006876c tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:09.463765 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-f27664f5-ebf3-4110-9c38-7b95f006876c tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 37698c73-94da-4904-a8d5-636936092fba] Going to try to terminate instance {{(pid=118726) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 19:26:09.474919 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-03ac3833-1c51-42a9-a5f8-9cc133ed5a48 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5cfee7994ab404d974d86d77e075209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33bb29688304d0dae3cfdc0eb54b7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:09.487554 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-03ac3833-1c51-42a9-a5f8-9cc133ed5a48 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] 10.222.0.16 "GET /compute/v2.1/servers/fb16e6d4-57d8-4185-9955-ec1d261b365d" status: 200 len: 1568 microversion: 2.1 time: 0.236571 Oct 31 19:26:09.489751 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 342/682] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:26:09 2022] GET /compute/v2.1/servers/fb16e6d4-57d8-4185-9955-ec1d261b365d => generated 1568 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:26:09.496303 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG dbcounter [-] [118726] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:26:09.550528 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-f27664f5-ebf3-4110-9c38-7b95f006876c tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "DELETE /compute/v2.1/servers/37698c73-94da-4904-a8d5-636936092fba" status: 204 len: 0 microversion: 2.1 time: 0.146576 Oct 31 19:26:09.551359 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 341/683] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 31 19:26:09 2022] DELETE /compute/v2.1/servers/37698c73-94da-4904-a8d5-636936092fba => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 19:26:09.559166 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-3bed89e6-1ecb-4b46-a68c-2c9aa0861c80 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:26:09.560029 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-3bed89e6-1ecb-4b46-a68c-2c9aa0861c80 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 37698c73-94da-4904-a8d5-636936092fba] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:26:09.571011 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-3bed89e6-1ecb-4b46-a68c-2c9aa0861c80 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:09.571697 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-3bed89e6-1ecb-4b46-a68c-2c9aa0861c80 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:09.572168 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-3bed89e6-1ecb-4b46-a68c-2c9aa0861c80 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:09.572911 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-3bed89e6-1ecb-4b46-a68c-2c9aa0861c80 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:09.573401 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-3bed89e6-1ecb-4b46-a68c-2c9aa0861c80 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:09.573902 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-3bed89e6-1ecb-4b46-a68c-2c9aa0861c80 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:09.727415 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-3bed89e6-1ecb-4b46-a68c-2c9aa0861c80 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc49f9eb3114759b2889ed8972136d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cf63c76fc543428404002ae9a75b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:09.735162 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-3bed89e6-1ecb-4b46-a68c-2c9aa0861c80 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/37698c73-94da-4904-a8d5-636936092fba" status: 200 len: 1506 microversion: 2.1 time: 0.179938 Oct 31 19:26:09.735735 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 343/684] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:26:09 2022] GET /compute/v2.1/servers/37698c73-94da-4904-a8d5-636936092fba => generated 1506 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:26:10.137387 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-6ea8ff38-0291-4562-a3fb-80fb0fe18c09 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:26:10.138114 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-6ea8ff38-0291-4562-a3fb-80fb0fe18c09 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] [instance: c96bdeca-16e0-4d90-a9f9-0f9d46799d68] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:26:10.144811 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-6ea8ff38-0291-4562-a3fb-80fb0fe18c09 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:10.145303 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-6ea8ff38-0291-4562-a3fb-80fb0fe18c09 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:10.145769 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-6ea8ff38-0291-4562-a3fb-80fb0fe18c09 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:10.146468 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-6ea8ff38-0291-4562-a3fb-80fb0fe18c09 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:10.146927 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-6ea8ff38-0291-4562-a3fb-80fb0fe18c09 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:10.147356 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-6ea8ff38-0291-4562-a3fb-80fb0fe18c09 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:10.272943 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-6ea8ff38-0291-4562-a3fb-80fb0fe18c09 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ece6ca9374764214bac6263bd691bc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9c317b548b40deb8cb27236d36d674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:10.281315 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-6ea8ff38-0291-4562-a3fb-80fb0fe18c09 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] 10.222.0.16 "GET /compute/v2.1/servers/c96bdeca-16e0-4d90-a9f9-0f9d46799d68" status: 200 len: 1360 microversion: 2.1 time: 0.148144 Oct 31 19:26:10.281923 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 342/685] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:26:10 2022] GET /compute/v2.1/servers/c96bdeca-16e0-4d90-a9f9-0f9d46799d68 => generated 1360 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:26:10.513345 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-84e32515-22e6-4417-9034-1d74146f7457 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:26:10.514052 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-84e32515-22e6-4417-9034-1d74146f7457 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] [instance: fb16e6d4-57d8-4185-9955-ec1d261b365d] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:26:10.521190 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-84e32515-22e6-4417-9034-1d74146f7457 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:10.521702 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-84e32515-22e6-4417-9034-1d74146f7457 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:10.522138 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-84e32515-22e6-4417-9034-1d74146f7457 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:10.522831 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-84e32515-22e6-4417-9034-1d74146f7457 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:10.523286 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-84e32515-22e6-4417-9034-1d74146f7457 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:10.523711 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-84e32515-22e6-4417-9034-1d74146f7457 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:10.665784 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-84e32515-22e6-4417-9034-1d74146f7457 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5cfee7994ab404d974d86d77e075209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33bb29688304d0dae3cfdc0eb54b7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:10.673846 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-84e32515-22e6-4417-9034-1d74146f7457 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] 10.222.0.16 "GET /compute/v2.1/servers/fb16e6d4-57d8-4185-9955-ec1d261b365d" status: 200 len: 1568 microversion: 2.1 time: 0.164216 Oct 31 19:26:10.674417 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 344/686] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:26:10 2022] GET /compute/v2.1/servers/fb16e6d4-57d8-4185-9955-ec1d261b365d => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:26:10.757465 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-e3ac554b-fa3b-4258-9f02-e327f89657cf tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:26:10.758056 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-e3ac554b-fa3b-4258-9f02-e327f89657cf tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 37698c73-94da-4904-a8d5-636936092fba] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:26:10.763920 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-e3ac554b-fa3b-4258-9f02-e327f89657cf tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:10.764397 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-e3ac554b-fa3b-4258-9f02-e327f89657cf tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:10.764824 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-e3ac554b-fa3b-4258-9f02-e327f89657cf tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:10.765506 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-e3ac554b-fa3b-4258-9f02-e327f89657cf tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:10.765983 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-e3ac554b-fa3b-4258-9f02-e327f89657cf tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:10.766400 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-e3ac554b-fa3b-4258-9f02-e327f89657cf tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:10.900399 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-e3ac554b-fa3b-4258-9f02-e327f89657cf tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc49f9eb3114759b2889ed8972136d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cf63c76fc543428404002ae9a75b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:10.908324 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-e3ac554b-fa3b-4258-9f02-e327f89657cf tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/37698c73-94da-4904-a8d5-636936092fba" status: 200 len: 1506 microversion: 2.1 time: 0.154715 Oct 31 19:26:10.913740 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 343/687] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:26:10 2022] GET /compute/v2.1/servers/37698c73-94da-4904-a8d5-636936092fba => generated 1506 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:26:11.015106 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-bc22414e-119d-4d51-90be-f31aad933e62 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-477765809"}} {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:26:11.015543 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-bc22414e-119d-4d51-90be-f31aad933e62 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] [instance: ecd39339-b802-43f3-aba3-432fd6e5387e] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:26:11.022064 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-bc22414e-119d-4d51-90be-f31aad933e62 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:11.022541 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-bc22414e-119d-4d51-90be-f31aad933e62 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:11.022970 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-bc22414e-119d-4d51-90be-f31aad933e62 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:11.023643 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-bc22414e-119d-4d51-90be-f31aad933e62 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:11.024092 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-bc22414e-119d-4d51-90be-f31aad933e62 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:11.024508 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-bc22414e-119d-4d51-90be-f31aad933e62 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:11.148266 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.network.security_group_api [None req-bc22414e-119d-4d51-90be-f31aad933e62 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Removing security group 275ada28-2ceb-4fef-9ebc-74981cf09323 from port 02358090-76d2-46a6-9956-91d3a84a985a Oct 31 19:26:11.304144 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-26d9128d-0171-4923-a5ea-0b61d9422100 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:26:11.304909 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-26d9128d-0171-4923-a5ea-0b61d9422100 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] [instance: c96bdeca-16e0-4d90-a9f9-0f9d46799d68] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:26:11.311328 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-26d9128d-0171-4923-a5ea-0b61d9422100 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:11.311808 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-26d9128d-0171-4923-a5ea-0b61d9422100 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:11.312241 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-26d9128d-0171-4923-a5ea-0b61d9422100 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:11.313010 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-26d9128d-0171-4923-a5ea-0b61d9422100 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:11.313464 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-26d9128d-0171-4923-a5ea-0b61d9422100 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:11.313955 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-26d9128d-0171-4923-a5ea-0b61d9422100 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:11.443240 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-26d9128d-0171-4923-a5ea-0b61d9422100 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ece6ca9374764214bac6263bd691bc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9c317b548b40deb8cb27236d36d674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:11.451248 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-26d9128d-0171-4923-a5ea-0b61d9422100 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] 10.222.0.16 "GET /compute/v2.1/servers/c96bdeca-16e0-4d90-a9f9-0f9d46799d68" status: 200 len: 1360 microversion: 2.1 time: 0.150968 Oct 31 19:26:11.451823 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 344/688] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:26:11 2022] GET /compute/v2.1/servers/c96bdeca-16e0-4d90-a9f9-0f9d46799d68 => generated 1360 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 19:26:11.459790 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-bc22414e-119d-4d51-90be-f31aad933e62 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] 10.222.0.16 "POST /compute/v2.1/servers/ecd39339-b802-43f3-aba3-432fd6e5387e/action" status: 202 len: 0 microversion: 2.1 time: 0.448704 Oct 31 19:26:11.463750 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 345/689] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 31 19:26:11 2022] POST /compute/v2.1/servers/ecd39339-b802-43f3-aba3-432fd6e5387e/action => generated 0 bytes in 450 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 19:26:11.474261 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [req-6c133918-8141-4530-a77d-208152222a5d req-91c1fc0c-94cc-4faa-b8d5-c4304eb1067b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ecd39339-b802-43f3-aba3-432fd6e5387e", "tag": "02358090-76d2-46a6-9956-91d3a84a985a"}]} {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:26:11.492849 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [req-6c133918-8141-4530-a77d-208152222a5d req-91c1fc0c-94cc-4faa-b8d5-c4304eb1067b service nova] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:11.493732 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [req-6c133918-8141-4530-a77d-208152222a5d req-91c1fc0c-94cc-4faa-b8d5-c4304eb1067b service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:11.494382 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [req-6c133918-8141-4530-a77d-208152222a5d req-91c1fc0c-94cc-4faa-b8d5-c4304eb1067b service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:11.507234 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.compute.server_external_events [req-6c133918-8141-4530-a77d-208152222a5d req-91c1fc0c-94cc-4faa-b8d5-c4304eb1067b service nova] Creating event network-changed:02358090-76d2-46a6-9956-91d3a84a985a for instance ecd39339-b802-43f3-aba3-432fd6e5387e on hv-cinder-86309 Oct 31 19:26:11.513391 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [req-6c133918-8141-4530-a77d-208152222a5d req-91c1fc0c-94cc-4faa-b8d5-c4304eb1067b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042766 Oct 31 19:26:11.514629 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 345/690] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 31 19:26:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:26:11.697586 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-b4dda20f-e607-4aea-8ea6-a55698e73dec tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:26:11.698261 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-b4dda20f-e607-4aea-8ea6-a55698e73dec tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] [instance: fb16e6d4-57d8-4185-9955-ec1d261b365d] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:26:11.707940 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-b4dda20f-e607-4aea-8ea6-a55698e73dec tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:11.708443 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-b4dda20f-e607-4aea-8ea6-a55698e73dec tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:11.708884 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-b4dda20f-e607-4aea-8ea6-a55698e73dec tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:11.712965 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-b4dda20f-e607-4aea-8ea6-a55698e73dec tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:11.714610 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-b4dda20f-e607-4aea-8ea6-a55698e73dec tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:11.716799 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-b4dda20f-e607-4aea-8ea6-a55698e73dec tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:11.933038 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-dfba5735-f96a-4a6c-9fe3-ba90f65df61e tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:26:11.934144 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-dfba5735-f96a-4a6c-9fe3-ba90f65df61e tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 37698c73-94da-4904-a8d5-636936092fba] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:26:11.940899 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-dfba5735-f96a-4a6c-9fe3-ba90f65df61e tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:11.941428 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-dfba5735-f96a-4a6c-9fe3-ba90f65df61e tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:11.941985 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-dfba5735-f96a-4a6c-9fe3-ba90f65df61e tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:11.942759 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-dfba5735-f96a-4a6c-9fe3-ba90f65df61e tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:11.943277 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-dfba5735-f96a-4a6c-9fe3-ba90f65df61e tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:11.943727 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-dfba5735-f96a-4a6c-9fe3-ba90f65df61e tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:12.116851 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-dfba5735-f96a-4a6c-9fe3-ba90f65df61e tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc49f9eb3114759b2889ed8972136d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cf63c76fc543428404002ae9a75b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:12.125125 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-dfba5735-f96a-4a6c-9fe3-ba90f65df61e tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/37698c73-94da-4904-a8d5-636936092fba" status: 200 len: 1506 microversion: 2.1 time: 0.196693 Oct 31 19:26:12.125728 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 346/691] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:26:11 2022] GET /compute/v2.1/servers/37698c73-94da-4904-a8d5-636936092fba => generated 1506 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:26:12.200126 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-b4dda20f-e607-4aea-8ea6-a55698e73dec tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5cfee7994ab404d974d86d77e075209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33bb29688304d0dae3cfdc0eb54b7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:12.208454 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-b4dda20f-e607-4aea-8ea6-a55698e73dec tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] 10.222.0.16 "GET /compute/v2.1/servers/fb16e6d4-57d8-4185-9955-ec1d261b365d" status: 200 len: 1568 microversion: 2.1 time: 0.515514 Oct 31 19:26:12.209263 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 346/692] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:26:11 2022] GET /compute/v2.1/servers/fb16e6d4-57d8-4185-9955-ec1d261b365d => generated 1568 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:26:12.475038 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-e4dc3d6c-2727-4b3e-b334-d5be860b43ef tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:26:12.475676 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-e4dc3d6c-2727-4b3e-b334-d5be860b43ef tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] [instance: c96bdeca-16e0-4d90-a9f9-0f9d46799d68] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:26:12.482191 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-e4dc3d6c-2727-4b3e-b334-d5be860b43ef tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:12.482666 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-e4dc3d6c-2727-4b3e-b334-d5be860b43ef tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:12.483093 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-e4dc3d6c-2727-4b3e-b334-d5be860b43ef tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:12.483774 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-e4dc3d6c-2727-4b3e-b334-d5be860b43ef tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:12.484223 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-e4dc3d6c-2727-4b3e-b334-d5be860b43ef tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:12.484641 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-e4dc3d6c-2727-4b3e-b334-d5be860b43ef tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:12.615084 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-e4dc3d6c-2727-4b3e-b334-d5be860b43ef tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ece6ca9374764214bac6263bd691bc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9c317b548b40deb8cb27236d36d674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:12.622630 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-e4dc3d6c-2727-4b3e-b334-d5be860b43ef tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] 10.222.0.16 "GET /compute/v2.1/servers/c96bdeca-16e0-4d90-a9f9-0f9d46799d68" status: 200 len: 1360 microversion: 2.1 time: 0.152267 Oct 31 19:26:12.623198 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 347/693] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:26:12 2022] GET /compute/v2.1/servers/c96bdeca-16e0-4d90-a9f9-0f9d46799d68 => generated 1360 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:26:13.107759 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-800d69a7-8b03-4006-bb20-ed9f78fde7bd tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:26:13.108970 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-800d69a7-8b03-4006-bb20-ed9f78fde7bd tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] [instance: ecd39339-b802-43f3-aba3-432fd6e5387e] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:26:13.116952 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-800d69a7-8b03-4006-bb20-ed9f78fde7bd tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:13.117982 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-800d69a7-8b03-4006-bb20-ed9f78fde7bd tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:13.118681 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-800d69a7-8b03-4006-bb20-ed9f78fde7bd tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:13.119623 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-800d69a7-8b03-4006-bb20-ed9f78fde7bd tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:13.120289 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-800d69a7-8b03-4006-bb20-ed9f78fde7bd tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:13.121009 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-800d69a7-8b03-4006-bb20-ed9f78fde7bd tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:13.147264 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-f5250f07-2db9-4a94-a37f-9ebe666d17eb tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:26:13.148393 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-f5250f07-2db9-4a94-a37f-9ebe666d17eb tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 37698c73-94da-4904-a8d5-636936092fba] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:26:13.150578 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG dbcounter [-] [118726] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=118726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:26:13.157218 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-f5250f07-2db9-4a94-a37f-9ebe666d17eb tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:13.161236 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-f5250f07-2db9-4a94-a37f-9ebe666d17eb tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:13.164357 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-f5250f07-2db9-4a94-a37f-9ebe666d17eb tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:13.165409 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-f5250f07-2db9-4a94-a37f-9ebe666d17eb tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:13.168560 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-f5250f07-2db9-4a94-a37f-9ebe666d17eb tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:13.169466 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-f5250f07-2db9-4a94-a37f-9ebe666d17eb tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:13.279128 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.objects.instance [None req-800d69a7-8b03-4006-bb20-ed9f78fde7bd tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lazy-loading 'services' on Instance uuid ecd39339-b802-43f3-aba3-432fd6e5387e {{(pid=118727) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 19:26:13.390810 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-800d69a7-8b03-4006-bb20-ed9f78fde7bd tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ecd39339-b802-43f3-aba3-432fd6e5387e/os-volume_attachments/7a9a6113-0daf-42e1-85ca-351667a63f62" status: 202 len: 0 microversion: 2.1 time: 0.287099 Oct 31 19:26:13.400528 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 347/694] 10.222.0.16 () {58 vars in 1416 bytes} [Mon Oct 31 19:26:13 2022] DELETE /compute/v2.1/servers/ecd39339-b802-43f3-aba3-432fd6e5387e/os-volume_attachments/7a9a6113-0daf-42e1-85ca-351667a63f62 => generated 0 bytes in 298 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 19:26:13.409631 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-738a1d36-9620-461f-a7b6-1e3f3cde8924 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:26:13.410717 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-738a1d36-9620-461f-a7b6-1e3f3cde8924 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] [instance: fb16e6d4-57d8-4185-9955-ec1d261b365d] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:26:13.421049 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-738a1d36-9620-461f-a7b6-1e3f3cde8924 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:13.421976 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-738a1d36-9620-461f-a7b6-1e3f3cde8924 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:13.423095 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-738a1d36-9620-461f-a7b6-1e3f3cde8924 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:13.424201 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-738a1d36-9620-461f-a7b6-1e3f3cde8924 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:13.425099 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-738a1d36-9620-461f-a7b6-1e3f3cde8924 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:13.426184 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-738a1d36-9620-461f-a7b6-1e3f3cde8924 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:13.475430 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-f5250f07-2db9-4a94-a37f-9ebe666d17eb tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc49f9eb3114759b2889ed8972136d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cf63c76fc543428404002ae9a75b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:13.486244 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-f5250f07-2db9-4a94-a37f-9ebe666d17eb tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/37698c73-94da-4904-a8d5-636936092fba" status: 200 len: 1506 microversion: 2.1 time: 0.342701 Oct 31 19:26:13.504081 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 348/695] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:26:13 2022] GET /compute/v2.1/servers/37698c73-94da-4904-a8d5-636936092fba => generated 1506 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 19:26:13.509912 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-0fe72903-2bc1-430f-9fc8-05513526d2df tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:26:13.512262 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-0fe72903-2bc1-430f-9fc8-05513526d2df tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] [instance: ecd39339-b802-43f3-aba3-432fd6e5387e] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:26:13.518192 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-0fe72903-2bc1-430f-9fc8-05513526d2df tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:13.518628 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-0fe72903-2bc1-430f-9fc8-05513526d2df tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:13.519068 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-0fe72903-2bc1-430f-9fc8-05513526d2df tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:13.519771 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-0fe72903-2bc1-430f-9fc8-05513526d2df tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:13.520222 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-0fe72903-2bc1-430f-9fc8-05513526d2df tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:13.520894 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-0fe72903-2bc1-430f-9fc8-05513526d2df tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:13.556097 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-0fe72903-2bc1-430f-9fc8-05513526d2df tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] 10.222.0.16 "GET /compute/v2.1/servers/ecd39339-b802-43f3-aba3-432fd6e5387e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050281 Oct 31 19:26:13.557561 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 349/696] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Oct 31 19:26:13 2022] GET /compute/v2.1/servers/ecd39339-b802-43f3-aba3-432fd6e5387e/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:26:13.627133 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [req-be53c149-9046-4801-85f7-36ac03fdaf19 req-f7e1591c-78e9-4b9c-b360-aa4b3a3538bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ecd39339-b802-43f3-aba3-432fd6e5387e", "tag": "02358090-76d2-46a6-9956-91d3a84a985a"}]} {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:26:13.637157 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [req-be53c149-9046-4801-85f7-36ac03fdaf19 req-f7e1591c-78e9-4b9c-b360-aa4b3a3538bb service nova] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:13.638060 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [req-be53c149-9046-4801-85f7-36ac03fdaf19 req-f7e1591c-78e9-4b9c-b360-aa4b3a3538bb service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:13.638495 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [req-be53c149-9046-4801-85f7-36ac03fdaf19 req-f7e1591c-78e9-4b9c-b360-aa4b3a3538bb service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:13.650309 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.compute.server_external_events [req-be53c149-9046-4801-85f7-36ac03fdaf19 req-f7e1591c-78e9-4b9c-b360-aa4b3a3538bb service nova] Creating event network-changed:02358090-76d2-46a6-9956-91d3a84a985a for instance ecd39339-b802-43f3-aba3-432fd6e5387e on hv-cinder-86309 Oct 31 19:26:13.655306 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [req-be53c149-9046-4801-85f7-36ac03fdaf19 req-f7e1591c-78e9-4b9c-b360-aa4b3a3538bb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096419 Oct 31 19:26:13.656069 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 350/697] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 31 19:26:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:26:13.661240 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-f2e1c704-e106-41d4-8360-237ccdac92a3 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:26:13.661966 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-f2e1c704-e106-41d4-8360-237ccdac92a3 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] [instance: c96bdeca-16e0-4d90-a9f9-0f9d46799d68] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:26:13.668487 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-f2e1c704-e106-41d4-8360-237ccdac92a3 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:13.668979 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-f2e1c704-e106-41d4-8360-237ccdac92a3 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:13.669407 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-f2e1c704-e106-41d4-8360-237ccdac92a3 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:13.670311 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-f2e1c704-e106-41d4-8360-237ccdac92a3 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:13.670764 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-f2e1c704-e106-41d4-8360-237ccdac92a3 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:13.671366 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-f2e1c704-e106-41d4-8360-237ccdac92a3 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:13.729659 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-738a1d36-9620-461f-a7b6-1e3f3cde8924 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5cfee7994ab404d974d86d77e075209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33bb29688304d0dae3cfdc0eb54b7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:13.751269 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-738a1d36-9620-461f-a7b6-1e3f3cde8924 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] 10.222.0.16 "GET /compute/v2.1/servers/fb16e6d4-57d8-4185-9955-ec1d261b365d" status: 200 len: 1568 microversion: 2.1 time: 0.347587 Oct 31 19:26:13.751935 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 348/698] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:26:13 2022] GET /compute/v2.1/servers/fb16e6d4-57d8-4185-9955-ec1d261b365d => generated 1568 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:26:13.846082 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-f2e1c704-e106-41d4-8360-237ccdac92a3 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ece6ca9374764214bac6263bd691bc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9c317b548b40deb8cb27236d36d674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:13.853889 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-f2e1c704-e106-41d4-8360-237ccdac92a3 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] 10.222.0.16 "GET /compute/v2.1/servers/c96bdeca-16e0-4d90-a9f9-0f9d46799d68" status: 200 len: 1360 microversion: 2.1 time: 0.196846 Oct 31 19:26:13.854457 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 351/699] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:26:13 2022] GET /compute/v2.1/servers/c96bdeca-16e0-4d90-a9f9-0f9d46799d68 => generated 1360 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:26:14.508285 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-7c65b89b-736c-4c7a-a02d-55f9df2a2899 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:26:14.508856 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-7c65b89b-736c-4c7a-a02d-55f9df2a2899 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 37698c73-94da-4904-a8d5-636936092fba] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:26:14.511262 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG dbcounter [-] [118727] Writing DB stats nova_cell0:SELECT=2 {{(pid=118727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:26:14.512023 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG dbcounter [-] [118727] Writing DB stats nova_cell0:SELECT=12 {{(pid=118727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:26:14.517465 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-7c65b89b-736c-4c7a-a02d-55f9df2a2899 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:14.517972 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-7c65b89b-736c-4c7a-a02d-55f9df2a2899 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:14.518404 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-7c65b89b-736c-4c7a-a02d-55f9df2a2899 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:14.519113 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-7c65b89b-736c-4c7a-a02d-55f9df2a2899 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:14.519567 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-7c65b89b-736c-4c7a-a02d-55f9df2a2899 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:14.519994 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-7c65b89b-736c-4c7a-a02d-55f9df2a2899 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:14.569650 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-07bcc0d5-7296-4cfe-a4dd-34883d498c37 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:26:14.571971 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-07bcc0d5-7296-4cfe-a4dd-34883d498c37 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] [instance: ecd39339-b802-43f3-aba3-432fd6e5387e] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:26:14.578558 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-07bcc0d5-7296-4cfe-a4dd-34883d498c37 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:14.579112 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-07bcc0d5-7296-4cfe-a4dd-34883d498c37 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:14.579614 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-07bcc0d5-7296-4cfe-a4dd-34883d498c37 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:14.580395 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-07bcc0d5-7296-4cfe-a4dd-34883d498c37 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:14.580977 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-07bcc0d5-7296-4cfe-a4dd-34883d498c37 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:14.581461 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-07bcc0d5-7296-4cfe-a4dd-34883d498c37 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:14.583158 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-7c65b89b-736c-4c7a-a02d-55f9df2a2899 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc49f9eb3114759b2889ed8972136d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cf63c76fc543428404002ae9a75b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:14.585507 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG dbcounter [-] [118727] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:26:14.592441 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-7c65b89b-736c-4c7a-a02d-55f9df2a2899 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/37698c73-94da-4904-a8d5-636936092fba" status: 200 len: 1464 microversion: 2.1 time: 0.088056 Oct 31 19:26:14.593015 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 349/700] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:26:14 2022] GET /compute/v2.1/servers/37698c73-94da-4904-a8d5-636936092fba => generated 1464 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:26:14.610570 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-07bcc0d5-7296-4cfe-a4dd-34883d498c37 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] 10.222.0.16 "GET /compute/v2.1/servers/ecd39339-b802-43f3-aba3-432fd6e5387e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045471 Oct 31 19:26:14.611124 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 352/701] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Oct 31 19:26:14 2022] GET /compute/v2.1/servers/ecd39339-b802-43f3-aba3-432fd6e5387e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 19:26:14.774870 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-7df40d95-d7bc-45fa-b44a-1fc5742bdac7 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:26:14.775385 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-7df40d95-d7bc-45fa-b44a-1fc5742bdac7 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] [instance: fb16e6d4-57d8-4185-9955-ec1d261b365d] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:26:14.782339 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-7df40d95-d7bc-45fa-b44a-1fc5742bdac7 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:14.782819 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-7df40d95-d7bc-45fa-b44a-1fc5742bdac7 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:14.783249 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-7df40d95-d7bc-45fa-b44a-1fc5742bdac7 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:14.783939 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-7df40d95-d7bc-45fa-b44a-1fc5742bdac7 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:14.784392 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-7df40d95-d7bc-45fa-b44a-1fc5742bdac7 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:14.784817 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-7df40d95-d7bc-45fa-b44a-1fc5742bdac7 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:14.875878 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-523e2db8-40f0-42ac-9b44-d7f329ff471e tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:26:14.876485 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-523e2db8-40f0-42ac-9b44-d7f329ff471e tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] [instance: c96bdeca-16e0-4d90-a9f9-0f9d46799d68] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:26:14.882361 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-523e2db8-40f0-42ac-9b44-d7f329ff471e tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:14.882844 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-523e2db8-40f0-42ac-9b44-d7f329ff471e tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:14.883284 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-523e2db8-40f0-42ac-9b44-d7f329ff471e tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:14.883970 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-523e2db8-40f0-42ac-9b44-d7f329ff471e tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:14.884426 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-523e2db8-40f0-42ac-9b44-d7f329ff471e tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:14.884854 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-523e2db8-40f0-42ac-9b44-d7f329ff471e tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:14.915558 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-7df40d95-d7bc-45fa-b44a-1fc5742bdac7 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5cfee7994ab404d974d86d77e075209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33bb29688304d0dae3cfdc0eb54b7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:14.923734 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-7df40d95-d7bc-45fa-b44a-1fc5742bdac7 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] 10.222.0.16 "GET /compute/v2.1/servers/fb16e6d4-57d8-4185-9955-ec1d261b365d" status: 200 len: 1568 microversion: 2.1 time: 0.152702 Oct 31 19:26:14.933644 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 350/702] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:26:14 2022] GET /compute/v2.1/servers/fb16e6d4-57d8-4185-9955-ec1d261b365d => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:26:15.014886 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-523e2db8-40f0-42ac-9b44-d7f329ff471e tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ece6ca9374764214bac6263bd691bc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9c317b548b40deb8cb27236d36d674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:15.022489 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-523e2db8-40f0-42ac-9b44-d7f329ff471e tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] 10.222.0.16 "GET /compute/v2.1/servers/c96bdeca-16e0-4d90-a9f9-0f9d46799d68" status: 200 len: 1360 microversion: 2.1 time: 0.150406 Oct 31 19:26:15.023057 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 353/703] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:26:14 2022] GET /compute/v2.1/servers/c96bdeca-16e0-4d90-a9f9-0f9d46799d68 => generated 1360 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 19:26:15.615314 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-343fc15a-3530-4dcd-a83f-3081c8d2bf7f tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:26:15.615974 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-343fc15a-3530-4dcd-a83f-3081c8d2bf7f tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 37698c73-94da-4904-a8d5-636936092fba] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:26:15.622449 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-343fc15a-3530-4dcd-a83f-3081c8d2bf7f tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:15.622912 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-343fc15a-3530-4dcd-a83f-3081c8d2bf7f tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:15.623095 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-4731b1c2-36e2-404e-a3a5-0d3bcf29ab40 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:26:15.623473 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-343fc15a-3530-4dcd-a83f-3081c8d2bf7f tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:15.624000 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-343fc15a-3530-4dcd-a83f-3081c8d2bf7f tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:15.624445 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-343fc15a-3530-4dcd-a83f-3081c8d2bf7f tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:15.624858 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-343fc15a-3530-4dcd-a83f-3081c8d2bf7f tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:15.625237 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-4731b1c2-36e2-404e-a3a5-0d3bcf29ab40 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] [instance: ecd39339-b802-43f3-aba3-432fd6e5387e] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:26:15.631487 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-4731b1c2-36e2-404e-a3a5-0d3bcf29ab40 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:15.631962 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-4731b1c2-36e2-404e-a3a5-0d3bcf29ab40 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:15.632390 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-4731b1c2-36e2-404e-a3a5-0d3bcf29ab40 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:15.633067 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-4731b1c2-36e2-404e-a3a5-0d3bcf29ab40 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:15.633513 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-4731b1c2-36e2-404e-a3a5-0d3bcf29ab40 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:15.633955 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-4731b1c2-36e2-404e-a3a5-0d3bcf29ab40 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:15.663259 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-4731b1c2-36e2-404e-a3a5-0d3bcf29ab40 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] 10.222.0.16 "GET /compute/v2.1/servers/ecd39339-b802-43f3-aba3-432fd6e5387e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043859 Oct 31 19:26:15.663752 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 354/704] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Oct 31 19:26:15 2022] GET /compute/v2.1/servers/ecd39339-b802-43f3-aba3-432fd6e5387e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 19:26:15.692708 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-343fc15a-3530-4dcd-a83f-3081c8d2bf7f tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc49f9eb3114759b2889ed8972136d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cf63c76fc543428404002ae9a75b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:15.692867 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [req-4e54f188-ef55-427d-98ca-fe89397a2151 req-2ee26945-f0ff-43ce-864f-6d86b080877f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37698c73-94da-4904-a8d5-636936092fba", "name": "network-vif-deleted", "tag": "ac17eb8a-95b3-4c82-b434-4b9b13313e65"}]} {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:26:15.700425 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-343fc15a-3530-4dcd-a83f-3081c8d2bf7f tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/37698c73-94da-4904-a8d5-636936092fba" status: 200 len: 1464 microversion: 2.1 time: 0.089588 Oct 31 19:26:15.700994 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 351/705] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:26:15 2022] GET /compute/v2.1/servers/37698c73-94da-4904-a8d5-636936092fba => generated 1464 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:26:15.701769 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [req-4e54f188-ef55-427d-98ca-fe89397a2151 req-2ee26945-f0ff-43ce-864f-6d86b080877f service nova] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:15.702239 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [req-4e54f188-ef55-427d-98ca-fe89397a2151 req-2ee26945-f0ff-43ce-864f-6d86b080877f service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:15.702662 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [req-4e54f188-ef55-427d-98ca-fe89397a2151 req-2ee26945-f0ff-43ce-864f-6d86b080877f service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:15.713592 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.compute.server_external_events [req-4e54f188-ef55-427d-98ca-fe89397a2151 req-2ee26945-f0ff-43ce-864f-6d86b080877f service nova] Creating event network-vif-deleted:ac17eb8a-95b3-4c82-b434-4b9b13313e65 for instance 37698c73-94da-4904-a8d5-636936092fba on hv-cinder-86309 Oct 31 19:26:15.718326 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [req-4e54f188-ef55-427d-98ca-fe89397a2151 req-2ee26945-f0ff-43ce-864f-6d86b080877f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029151 Oct 31 19:26:15.718885 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 355/706] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 31 19:26:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 19:26:15.947970 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-172dd47c-c826-4edf-b735-b3fe9d4ebbdd tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:26:15.948549 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-172dd47c-c826-4edf-b735-b3fe9d4ebbdd tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] [instance: fb16e6d4-57d8-4185-9955-ec1d261b365d] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:26:15.954453 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-172dd47c-c826-4edf-b735-b3fe9d4ebbdd tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:15.954929 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-172dd47c-c826-4edf-b735-b3fe9d4ebbdd tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:15.955361 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-172dd47c-c826-4edf-b735-b3fe9d4ebbdd tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:15.956037 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-172dd47c-c826-4edf-b735-b3fe9d4ebbdd tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:15.956492 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-172dd47c-c826-4edf-b735-b3fe9d4ebbdd tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:15.956914 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-172dd47c-c826-4edf-b735-b3fe9d4ebbdd tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:16.046580 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-3a407499-f8d2-4a61-be52-a62e7c04978e tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:26:16.047279 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-3a407499-f8d2-4a61-be52-a62e7c04978e tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] [instance: c96bdeca-16e0-4d90-a9f9-0f9d46799d68] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:26:16.053377 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-3a407499-f8d2-4a61-be52-a62e7c04978e tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:16.053895 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-3a407499-f8d2-4a61-be52-a62e7c04978e tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:16.054796 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-3a407499-f8d2-4a61-be52-a62e7c04978e tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:16.056539 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-3a407499-f8d2-4a61-be52-a62e7c04978e tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:16.057002 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-3a407499-f8d2-4a61-be52-a62e7c04978e tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:16.057431 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-3a407499-f8d2-4a61-be52-a62e7c04978e tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:16.087925 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-172dd47c-c826-4edf-b735-b3fe9d4ebbdd tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5cfee7994ab404d974d86d77e075209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33bb29688304d0dae3cfdc0eb54b7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:16.095658 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-172dd47c-c826-4edf-b735-b3fe9d4ebbdd tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] 10.222.0.16 "GET /compute/v2.1/servers/fb16e6d4-57d8-4185-9955-ec1d261b365d" status: 200 len: 1568 microversion: 2.1 time: 0.151628 Oct 31 19:26:16.096222 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 352/707] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:26:15 2022] GET /compute/v2.1/servers/fb16e6d4-57d8-4185-9955-ec1d261b365d => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:26:16.183005 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-3a407499-f8d2-4a61-be52-a62e7c04978e tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ece6ca9374764214bac6263bd691bc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9c317b548b40deb8cb27236d36d674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:16.190459 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-3a407499-f8d2-4a61-be52-a62e7c04978e tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] 10.222.0.16 "GET /compute/v2.1/servers/c96bdeca-16e0-4d90-a9f9-0f9d46799d68" status: 200 len: 1360 microversion: 2.1 time: 0.148012 Oct 31 19:26:16.191025 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 356/708] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:26:16 2022] GET /compute/v2.1/servers/c96bdeca-16e0-4d90-a9f9-0f9d46799d68 => generated 1360 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 19:26:16.679367 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-020b8697-76d6-4862-b817-5f42ad9bc859 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:26:16.682492 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-020b8697-76d6-4862-b817-5f42ad9bc859 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] [instance: ecd39339-b802-43f3-aba3-432fd6e5387e] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:26:16.689519 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-020b8697-76d6-4862-b817-5f42ad9bc859 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:16.690433 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-020b8697-76d6-4862-b817-5f42ad9bc859 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:16.691400 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-020b8697-76d6-4862-b817-5f42ad9bc859 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:16.692932 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-020b8697-76d6-4862-b817-5f42ad9bc859 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:16.693695 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-020b8697-76d6-4862-b817-5f42ad9bc859 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:16.694345 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-020b8697-76d6-4862-b817-5f42ad9bc859 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:16.724408 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-725ad964-2193-4184-9672-e1dde034bb08 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:26:16.725833 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-725ad964-2193-4184-9672-e1dde034bb08 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 37698c73-94da-4904-a8d5-636936092fba] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:26:16.742420 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-725ad964-2193-4184-9672-e1dde034bb08 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:16.743969 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-725ad964-2193-4184-9672-e1dde034bb08 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:16.745487 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-725ad964-2193-4184-9672-e1dde034bb08 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:16.746487 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-725ad964-2193-4184-9672-e1dde034bb08 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:16.747575 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-725ad964-2193-4184-9672-e1dde034bb08 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:16.748245 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-725ad964-2193-4184-9672-e1dde034bb08 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:16.750018 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-020b8697-76d6-4862-b817-5f42ad9bc859 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] 10.222.0.16 "GET /compute/v2.1/servers/ecd39339-b802-43f3-aba3-432fd6e5387e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077598 Oct 31 19:26:16.751653 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 353/709] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Oct 31 19:26:16 2022] GET /compute/v2.1/servers/ecd39339-b802-43f3-aba3-432fd6e5387e/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:26:16.785263 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-725ad964-2193-4184-9672-e1dde034bb08 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:16.785813 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-725ad964-2193-4184-9672-e1dde034bb08 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:16.786283 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-725ad964-2193-4184-9672-e1dde034bb08 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:16.786728 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.objects.instance [None req-725ad964-2193-4184-9672-e1dde034bb08 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lazy-loading 'fault' on Instance uuid 37698c73-94da-4904-a8d5-636936092fba {{(pid=118726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 19:26:16.828890 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-725ad964-2193-4184-9672-e1dde034bb08 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc49f9eb3114759b2889ed8972136d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cf63c76fc543428404002ae9a75b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:16.837006 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-725ad964-2193-4184-9672-e1dde034bb08 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/37698c73-94da-4904-a8d5-636936092fba" status: 200 len: 1311 microversion: 2.1 time: 0.117262 Oct 31 19:26:16.837738 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 357/710] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:26:16 2022] GET /compute/v2.1/servers/37698c73-94da-4904-a8d5-636936092fba => generated 1311 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:26:17.118786 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-bca29333-959d-490c-a27a-8b6bde07a088 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:26:17.119396 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-bca29333-959d-490c-a27a-8b6bde07a088 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] [instance: fb16e6d4-57d8-4185-9955-ec1d261b365d] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:26:17.126026 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-bca29333-959d-490c-a27a-8b6bde07a088 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:17.126501 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-bca29333-959d-490c-a27a-8b6bde07a088 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:17.126928 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-bca29333-959d-490c-a27a-8b6bde07a088 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:17.127611 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-bca29333-959d-490c-a27a-8b6bde07a088 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:17.128058 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-bca29333-959d-490c-a27a-8b6bde07a088 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:17.128477 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-bca29333-959d-490c-a27a-8b6bde07a088 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:17.212709 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-d99abdc1-a7b8-4e17-80f4-3d6315d82261 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:26:17.213313 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-d99abdc1-a7b8-4e17-80f4-3d6315d82261 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] [instance: c96bdeca-16e0-4d90-a9f9-0f9d46799d68] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:26:17.219493 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-d99abdc1-a7b8-4e17-80f4-3d6315d82261 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:17.219976 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-d99abdc1-a7b8-4e17-80f4-3d6315d82261 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:17.220408 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-d99abdc1-a7b8-4e17-80f4-3d6315d82261 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:17.221129 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-d99abdc1-a7b8-4e17-80f4-3d6315d82261 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:17.221583 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-d99abdc1-a7b8-4e17-80f4-3d6315d82261 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:17.222339 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-d99abdc1-a7b8-4e17-80f4-3d6315d82261 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:17.265858 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-bca29333-959d-490c-a27a-8b6bde07a088 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5cfee7994ab404d974d86d77e075209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33bb29688304d0dae3cfdc0eb54b7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:17.274004 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-bca29333-959d-490c-a27a-8b6bde07a088 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] 10.222.0.16 "GET /compute/v2.1/servers/fb16e6d4-57d8-4185-9955-ec1d261b365d" status: 200 len: 1568 microversion: 2.1 time: 0.158993 Oct 31 19:26:17.274769 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 354/711] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:26:17 2022] GET /compute/v2.1/servers/fb16e6d4-57d8-4185-9955-ec1d261b365d => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:26:17.360739 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-d99abdc1-a7b8-4e17-80f4-3d6315d82261 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ece6ca9374764214bac6263bd691bc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9c317b548b40deb8cb27236d36d674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:17.369760 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-d99abdc1-a7b8-4e17-80f4-3d6315d82261 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] 10.222.0.16 "GET /compute/v2.1/servers/c96bdeca-16e0-4d90-a9f9-0f9d46799d68" status: 200 len: 1360 microversion: 2.1 time: 0.160767 Oct 31 19:26:17.380941 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 358/712] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:26:17 2022] GET /compute/v2.1/servers/c96bdeca-16e0-4d90-a9f9-0f9d46799d68 => generated 1360 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 19:26:17.764214 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-1b268358-6558-4e5f-b174-b9b598706ac6 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:26:17.767357 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-1b268358-6558-4e5f-b174-b9b598706ac6 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] [instance: ecd39339-b802-43f3-aba3-432fd6e5387e] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:26:17.776453 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-1b268358-6558-4e5f-b174-b9b598706ac6 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:17.776453 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-1b268358-6558-4e5f-b174-b9b598706ac6 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:17.776768 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-1b268358-6558-4e5f-b174-b9b598706ac6 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:17.777407 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-1b268358-6558-4e5f-b174-b9b598706ac6 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:17.777887 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-1b268358-6558-4e5f-b174-b9b598706ac6 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:17.778443 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-1b268358-6558-4e5f-b174-b9b598706ac6 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:17.814181 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-1b268358-6558-4e5f-b174-b9b598706ac6 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] 10.222.0.16 "GET /compute/v2.1/servers/ecd39339-b802-43f3-aba3-432fd6e5387e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054442 Oct 31 19:26:17.814751 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 355/713] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Oct 31 19:26:17 2022] GET /compute/v2.1/servers/ecd39339-b802-43f3-aba3-432fd6e5387e/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 19:26:17.825916 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-16fbb818-6de8-48b7-b7bf-a08c296bade3 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:26:17.827095 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-16fbb818-6de8-48b7-b7bf-a08c296bade3 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] [instance: ecd39339-b802-43f3-aba3-432fd6e5387e] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:26:17.834413 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-16fbb818-6de8-48b7-b7bf-a08c296bade3 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:17.834901 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-16fbb818-6de8-48b7-b7bf-a08c296bade3 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:17.835332 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-16fbb818-6de8-48b7-b7bf-a08c296bade3 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:17.836108 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-16fbb818-6de8-48b7-b7bf-a08c296bade3 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:17.836474 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-16fbb818-6de8-48b7-b7bf-a08c296bade3 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:17.836849 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-16fbb818-6de8-48b7-b7bf-a08c296bade3 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:17.839921 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG dbcounter [-] [118726] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:26:17.860860 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-27d1eaba-8364-4daa-9658-c7d4121a37a5 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:26:17.861442 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-27d1eaba-8364-4daa-9658-c7d4121a37a5 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 37698c73-94da-4904-a8d5-636936092fba] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:26:17.867633 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-27d1eaba-8364-4daa-9658-c7d4121a37a5 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:17.868081 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-27d1eaba-8364-4daa-9658-c7d4121a37a5 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:17.868520 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-27d1eaba-8364-4daa-9658-c7d4121a37a5 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:17.869243 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-27d1eaba-8364-4daa-9658-c7d4121a37a5 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:17.869750 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-27d1eaba-8364-4daa-9658-c7d4121a37a5 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:17.870176 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-27d1eaba-8364-4daa-9658-c7d4121a37a5 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:17.885688 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.wsgi [None req-27d1eaba-8364-4daa-9658-c7d4121a37a5 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] HTTP exception thrown: Instance 37698c73-94da-4904-a8d5-636936092fba could not be found. Oct 31 19:26:17.887396 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-27d1eaba-8364-4daa-9658-c7d4121a37a5 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Request method failure captured: Oct 31 19:26:17.887396 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: request: GET /compute/v2.1/servers/37698c73-94da-4904-a8d5-636936092fba HTTP/1.1 Oct 31 19:26:17.887396 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Accept: application/json Oct 31 19:26:17.887396 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Accept-Encoding: identity Oct 31 19:26:17.887396 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Connection: close Oct 31 19:26:17.887396 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Content-Length: 0 Oct 31 19:26:17.887396 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Content-Type: application/json Oct 31 19:26:17.887396 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Host: 10.222.0.16 Oct 31 19:26:17.887396 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Openstack-System-Scope: None Oct 31 19:26:17.887396 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: User-Agent: python-urllib3/1.26.12 Oct 31 19:26:17.887396 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Auth-Token: gAAAAABjYCAUQ8YIOE1LqUgdd-VNJVSMmtJLqLbK8GSGQuylkQibi1W0G15Xlmc42Ab2ILvZHAFaOwUXTuxHL77kGeaOPHnfv7wa7hvLMGAh1mz7JFprCgygCLONv8fHZR7cWDh7VdBpvVSZYSPSFRHB1FTdSs8ZWKVZbGgsG6vqf9BFw1oXMP8 Oct 31 19:26:17.887396 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Domain-Id: None Oct 31 19:26:17.887396 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Domain-Name: None Oct 31 19:26:17.887396 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Identity-Status: Confirmed Oct 31 19:26:17.887396 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Is-Admin-Project: True Oct 31 19:26:17.887396 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Project-Domain-Id: default Oct 31 19:26:17.887396 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Project-Domain-Name: Default Oct 31 19:26:17.887396 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Project-Id: 73cf63c76fc543428404002ae9a75b29 Oct 31 19:26:17.887396 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-466281787 Oct 31 19:26:17.887396 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Role: member,reader Oct 31 19:26:17.887396 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Roles: member,reader Oct 31 19:26:17.888841 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/73cf63c76fc543428404002ae9a75b29"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_73cf63c76fc543428404002ae9a75b29", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/73cf63c76fc543428404002ae9a75b29"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/73cf63c76fc543428404002ae9a75b29"}]}] Oct 31 19:26:17.888841 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Tenant: tempest-ServerRescueNegativeTestJSON-466281787 Oct 31 19:26:17.888841 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Tenant-Id: 73cf63c76fc543428404002ae9a75b29 Oct 31 19:26:17.888841 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-466281787 Oct 31 19:26:17.888841 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User: tempest-ServerRescueNegativeTestJSON-466281787-project Oct 31 19:26:17.888841 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User-Domain-Id: default Oct 31 19:26:17.888841 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User-Domain-Name: Default Oct 31 19:26:17.888841 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User-Id: ddc49f9eb3114759b2889ed8972136d8 Oct 31 19:26:17.888841 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User-Name: tempest-ServerRescueNegativeTestJSON-466281787-project Oct 31 19:26:17.888841 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: method: > Oct 31 19:26:17.888841 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: exception: Instance 37698c73-94da-4904-a8d5-636936092fba could not be found. Oct 31 19:26:17.888841 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: action_args: {'id': '37698c73-94da-4904-a8d5-636936092fba'} Oct 31 19:26:17.889794 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 19:26:17.889794 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:26:17.889794 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 19:26:17.889794 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 19:26:17.889794 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 19:26:17.889794 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 19:26:17.889794 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 19:26:17.889794 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 19:26:17.889794 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 19:26:17.889794 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 19:26:17.889794 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37698c73-94da-4904-a8d5-636936092fba could not be found. Oct 31 19:26:17.889794 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:26:17.889794 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 19:26:17.889794 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:26:17.889794 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:26:17.889794 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 19:26:17.889794 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 19:26:17.889794 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 19:26:17.889794 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 19:26:17.889794 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 19:26:17.891273 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 19:26:17.891273 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 19:26:17.891273 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 19:26:17.891273 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 19:26:17.891273 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 19:26:17.891273 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 19:26:17.891273 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 19:26:17.891273 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37698c73-94da-4904-a8d5-636936092fba could not be found. Oct 31 19:26:17.891273 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:26:17.891273 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 19:26:17.891273 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:26:17.891273 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:26:17.891273 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 19:26:17.891273 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 19:26:17.891273 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 19:26:17.891273 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 19:26:17.891273 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37698c73-94da-4904-a8d5-636936092fba could not be found. Oct 31 19:26:17.891273 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:26:17.893053 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-27d1eaba-8364-4daa-9658-c7d4121a37a5 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Returning 404 to user: Instance 37698c73-94da-4904-a8d5-636936092fba could not be found. {{(pid=118727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 19:26:17.893053 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-27d1eaba-8364-4daa-9658-c7d4121a37a5 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/37698c73-94da-4904-a8d5-636936092fba" status: 404 len: 111 microversion: 2.1 time: 0.033004 Oct 31 19:26:17.893053 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 356/714] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:26:17 2022] GET /compute/v2.1/servers/37698c73-94da-4904-a8d5-636936092fba => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 19:26:17.897997 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-65de9504-6c7b-4da2-acd4-3e1bb51267b3 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:26:17.898489 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-65de9504-6c7b-4da2-acd4-3e1bb51267b3 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 7a47cd33-e4a0-4b78-9afc-2f371e4a9d10] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:26:17.904248 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-65de9504-6c7b-4da2-acd4-3e1bb51267b3 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:17.904750 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-65de9504-6c7b-4da2-acd4-3e1bb51267b3 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:17.905162 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-65de9504-6c7b-4da2-acd4-3e1bb51267b3 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:17.905869 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-65de9504-6c7b-4da2-acd4-3e1bb51267b3 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:17.906324 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-65de9504-6c7b-4da2-acd4-3e1bb51267b3 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:17.906906 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-65de9504-6c7b-4da2-acd4-3e1bb51267b3 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:17.928161 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.wsgi [None req-16fbb818-6de8-48b7-b7bf-a08c296bade3 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] HTTP exception thrown: Instance ecd39339-b802-43f3-aba3-432fd6e5387e is not attached to volume 7a9a6113-0daf-42e1-85ca-351667a63f62 Oct 31 19:26:17.932698 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-65de9504-6c7b-4da2-acd4-3e1bb51267b3 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 7a47cd33-e4a0-4b78-9afc-2f371e4a9d10] Going to try to terminate instance {{(pid=118727) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 19:26:17.935097 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-16fbb818-6de8-48b7-b7bf-a08c296bade3 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Request method failure captured: Oct 31 19:26:17.935097 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: request: DELETE /compute/v2.1/servers/ecd39339-b802-43f3-aba3-432fd6e5387e/os-volume_attachments/7a9a6113-0daf-42e1-85ca-351667a63f62 HTTP/1.1 Oct 31 19:26:17.935097 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: Accept: application/json Oct 31 19:26:17.935097 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: Accept-Encoding: identity Oct 31 19:26:17.935097 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: Connection: close Oct 31 19:26:17.935097 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: Content-Length: 0 Oct 31 19:26:17.935097 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: Content-Type: application/json Oct 31 19:26:17.935097 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: Host: 10.222.0.16 Oct 31 19:26:17.935097 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: Openstack-System-Scope: None Oct 31 19:26:17.935097 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: User-Agent: python-urllib3/1.26.12 Oct 31 19:26:17.935097 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Auth-Token: gAAAAABjYCB7GBzR8vO7CDMfQCRZdoyE1Gx8gra7aSq_I_aSPvne4QDaF1OxwapHSnUj0aYt8N2C6VCiZ-7PFtEt3Bl-4c83A_8lKxqH_-56yRDPQKH4dQfNHHF4hIqCb4PgYfcKVJmH1bbhIvqrhWrpovSJNclpM0It-g-okFeY697dYkjoTfE Oct 31 19:26:17.935097 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Domain-Id: None Oct 31 19:26:17.935097 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Domain-Name: None Oct 31 19:26:17.935097 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Identity-Status: Confirmed Oct 31 19:26:17.935097 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Is-Admin-Project: True Oct 31 19:26:17.935097 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Project-Domain-Id: default Oct 31 19:26:17.935097 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Project-Domain-Name: Default Oct 31 19:26:17.935097 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Project-Id: c47ae1789d284a72bb71a6ffe55e7d8b Oct 31 19:26:17.935097 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Project-Name: tempest-TestMinimumBasicScenario-1687534068 Oct 31 19:26:17.935097 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Role: member,reader Oct 31 19:26:17.935097 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Roles: member,reader Oct 31 19:26:17.936476 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c47ae1789d284a72bb71a6ffe55e7d8b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c47ae1789d284a72bb71a6ffe55e7d8b", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c47ae1789d284a72bb71a6ffe55e7d8b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c47ae1789d284a72bb71a6ffe55e7d8b"}]}] Oct 31 19:26:17.936476 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Tenant: tempest-TestMinimumBasicScenario-1687534068 Oct 31 19:26:17.936476 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Tenant-Id: c47ae1789d284a72bb71a6ffe55e7d8b Oct 31 19:26:17.936476 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1687534068 Oct 31 19:26:17.936476 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-User: tempest-TestMinimumBasicScenario-1687534068-project Oct 31 19:26:17.936476 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-User-Domain-Id: default Oct 31 19:26:17.936476 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-User-Domain-Name: Default Oct 31 19:26:17.936476 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-User-Id: 34b652cca4b94e188b7362606edabb30 Oct 31 19:26:17.936476 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-User-Name: tempest-TestMinimumBasicScenario-1687534068-project Oct 31 19:26:17.936476 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: method: > Oct 31 19:26:17.936476 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: exception: Instance ecd39339-b802-43f3-aba3-432fd6e5387e is not attached to volume 7a9a6113-0daf-42e1-85ca-351667a63f62 Oct 31 19:26:17.937261 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: action_args: {'server_id': 'ecd39339-b802-43f3-aba3-432fd6e5387e', 'id': '7a9a6113-0daf-42e1-85ca-351667a63f62'} Oct 31 19:26:17.937261 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 19:26:17.937261 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:26:17.937261 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 31 19:26:17.937261 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 31 19:26:17.937261 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 31 19:26:17.937261 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 31 19:26:17.937261 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 31 19:26:17.937261 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 31 19:26:17.937261 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 7a9a6113-0daf-42e1-85ca-351667a63f62. Oct 31 19:26:17.937261 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Oct 31 19:26:17.937261 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 19:26:17.937261 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Oct 31 19:26:17.937261 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:26:17.937261 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 19:26:17.937261 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 19:26:17.937261 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 19:26:17.937261 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 19:26:17.937261 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 19:26:17.938565 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 19:26:17.938565 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 31 19:26:17.938565 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 31 19:26:17.938565 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ecd39339-b802-43f3-aba3-432fd6e5387e is not attached to volume 7a9a6113-0daf-42e1-85ca-351667a63f62 Oct 31 19:26:17.938565 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Oct 31 19:26:17.938565 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 19:26:17.938565 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Oct 31 19:26:17.938565 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:26:17.938565 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 19:26:17.938565 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 19:26:17.938565 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 19:26:17.938565 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 19:26:17.938565 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ecd39339-b802-43f3-aba3-432fd6e5387e is not attached to volume 7a9a6113-0daf-42e1-85ca-351667a63f62 Oct 31 19:26:17.938565 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Oct 31 19:26:17.938565 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-16fbb818-6de8-48b7-b7bf-a08c296bade3 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Returning 404 to user: Instance ecd39339-b802-43f3-aba3-432fd6e5387e is not attached to volume 7a9a6113-0daf-42e1-85ca-351667a63f62 {{(pid=118726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 19:26:17.939643 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-16fbb818-6de8-48b7-b7bf-a08c296bade3 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ecd39339-b802-43f3-aba3-432fd6e5387e/os-volume_attachments/7a9a6113-0daf-42e1-85ca-351667a63f62" status: 404 len: 154 microversion: 2.1 time: 0.114744 Oct 31 19:26:17.939643 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 359/715] 10.222.0.16 () {58 vars in 1416 bytes} [Mon Oct 31 19:26:17 2022] DELETE /compute/v2.1/servers/ecd39339-b802-43f3-aba3-432fd6e5387e/os-volume_attachments/7a9a6113-0daf-42e1-85ca-351667a63f62 => generated 154 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 19:26:18.015558 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-65de9504-6c7b-4da2-acd4-3e1bb51267b3 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7a47cd33-e4a0-4b78-9afc-2f371e4a9d10" status: 204 len: 0 microversion: 2.1 time: 0.120699 Oct 31 19:26:18.016332 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 357/716] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 31 19:26:17 2022] DELETE /compute/v2.1/servers/7a47cd33-e4a0-4b78-9afc-2f371e4a9d10 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 19:26:18.025557 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-6ff68319-67d3-4ec9-95a9-d49347b5f876 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:26:18.026230 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-6ff68319-67d3-4ec9-95a9-d49347b5f876 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 7a47cd33-e4a0-4b78-9afc-2f371e4a9d10] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:26:18.032442 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-6ff68319-67d3-4ec9-95a9-d49347b5f876 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:18.032921 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-6ff68319-67d3-4ec9-95a9-d49347b5f876 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:18.033364 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-6ff68319-67d3-4ec9-95a9-d49347b5f876 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:18.034070 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-6ff68319-67d3-4ec9-95a9-d49347b5f876 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:18.034524 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-6ff68319-67d3-4ec9-95a9-d49347b5f876 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:18.034959 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-6ff68319-67d3-4ec9-95a9-d49347b5f876 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:18.161865 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-6ff68319-67d3-4ec9-95a9-d49347b5f876 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc49f9eb3114759b2889ed8972136d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cf63c76fc543428404002ae9a75b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:18.169803 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-6ff68319-67d3-4ec9-95a9-d49347b5f876 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/7a47cd33-e4a0-4b78-9afc-2f371e4a9d10" status: 200 len: 1520 microversion: 2.1 time: 0.148452 Oct 31 19:26:18.170366 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 360/717] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:26:18 2022] GET /compute/v2.1/servers/7a47cd33-e4a0-4b78-9afc-2f371e4a9d10 => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:26:18.298414 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-59cc586c-a0fb-4b85-a8a1-181a98271652 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:26:18.299117 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-59cc586c-a0fb-4b85-a8a1-181a98271652 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] [instance: fb16e6d4-57d8-4185-9955-ec1d261b365d] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:26:18.306664 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-59cc586c-a0fb-4b85-a8a1-181a98271652 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:18.307138 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-59cc586c-a0fb-4b85-a8a1-181a98271652 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:18.307563 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-59cc586c-a0fb-4b85-a8a1-181a98271652 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:18.308243 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-59cc586c-a0fb-4b85-a8a1-181a98271652 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:18.308694 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-59cc586c-a0fb-4b85-a8a1-181a98271652 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:18.309130 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-59cc586c-a0fb-4b85-a8a1-181a98271652 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:18.395631 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-9dec9c0b-ae45-45f2-a7d1-e85f8f3ddfd0 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:26:18.396395 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-9dec9c0b-ae45-45f2-a7d1-e85f8f3ddfd0 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] [instance: c96bdeca-16e0-4d90-a9f9-0f9d46799d68] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:26:18.402881 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-9dec9c0b-ae45-45f2-a7d1-e85f8f3ddfd0 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:18.403605 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-9dec9c0b-ae45-45f2-a7d1-e85f8f3ddfd0 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:18.404283 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-9dec9c0b-ae45-45f2-a7d1-e85f8f3ddfd0 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:18.405060 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-9dec9c0b-ae45-45f2-a7d1-e85f8f3ddfd0 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:18.405590 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-9dec9c0b-ae45-45f2-a7d1-e85f8f3ddfd0 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:18.406118 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-9dec9c0b-ae45-45f2-a7d1-e85f8f3ddfd0 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:18.463609 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-59cc586c-a0fb-4b85-a8a1-181a98271652 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5cfee7994ab404d974d86d77e075209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33bb29688304d0dae3cfdc0eb54b7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:18.472401 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-59cc586c-a0fb-4b85-a8a1-181a98271652 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] 10.222.0.16 "GET /compute/v2.1/servers/fb16e6d4-57d8-4185-9955-ec1d261b365d" status: 200 len: 1568 microversion: 2.1 time: 0.179007 Oct 31 19:26:18.480827 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 358/718] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:26:18 2022] GET /compute/v2.1/servers/fb16e6d4-57d8-4185-9955-ec1d261b365d => generated 1568 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:26:18.537933 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [req-6f37907e-45ba-451d-96b4-f0ee29a970e0 req-aec11c65-b96f-4ae2-b989-cc3027b83b76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c96bdeca-16e0-4d90-a9f9-0f9d46799d68", "name": "network-vif-plugged", "status": "completed", "tag": "6abee1f4-a65e-4f4f-9235-4bfd378d8389"}]} {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:26:18.543879 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-9dec9c0b-ae45-45f2-a7d1-e85f8f3ddfd0 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ece6ca9374764214bac6263bd691bc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9c317b548b40deb8cb27236d36d674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:18.550729 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [req-6f37907e-45ba-451d-96b4-f0ee29a970e0 req-aec11c65-b96f-4ae2-b989-cc3027b83b76 service nova] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:18.551200 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [req-6f37907e-45ba-451d-96b4-f0ee29a970e0 req-aec11c65-b96f-4ae2-b989-cc3027b83b76 service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:18.551760 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [req-6f37907e-45ba-451d-96b4-f0ee29a970e0 req-aec11c65-b96f-4ae2-b989-cc3027b83b76 service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:18.553840 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-9dec9c0b-ae45-45f2-a7d1-e85f8f3ddfd0 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] 10.222.0.16 "GET /compute/v2.1/servers/c96bdeca-16e0-4d90-a9f9-0f9d46799d68" status: 200 len: 1360 microversion: 2.1 time: 0.162481 Oct 31 19:26:18.563086 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.compute.server_external_events [req-6f37907e-45ba-451d-96b4-f0ee29a970e0 req-aec11c65-b96f-4ae2-b989-cc3027b83b76 service nova] Creating event network-vif-plugged:6abee1f4-a65e-4f4f-9235-4bfd378d8389 for instance c96bdeca-16e0-4d90-a9f9-0f9d46799d68 on hv-cinder-86309 Oct 31 19:26:18.568477 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [req-6f37907e-45ba-451d-96b4-f0ee29a970e0 req-aec11c65-b96f-4ae2-b989-cc3027b83b76 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037854 Oct 31 19:26:18.569208 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 359/719] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 31 19:26:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 19:26:18.569497 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 361/720] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:26:18 2022] GET /compute/v2.1/servers/c96bdeca-16e0-4d90-a9f9-0f9d46799d68 => generated 1360 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 19:26:19.082520 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-36a47cd8-0a71-4e18-bf1e-7bcb312e6c22 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:26:19.083095 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-36a47cd8-0a71-4e18-bf1e-7bcb312e6c22 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] [instance: ecd39339-b802-43f3-aba3-432fd6e5387e] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:26:19.089558 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-36a47cd8-0a71-4e18-bf1e-7bcb312e6c22 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:19.090071 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-36a47cd8-0a71-4e18-bf1e-7bcb312e6c22 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:19.090496 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-36a47cd8-0a71-4e18-bf1e-7bcb312e6c22 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:19.091172 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-36a47cd8-0a71-4e18-bf1e-7bcb312e6c22 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:19.091618 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-36a47cd8-0a71-4e18-bf1e-7bcb312e6c22 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:19.092036 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-36a47cd8-0a71-4e18-bf1e-7bcb312e6c22 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:19.115957 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-36a47cd8-0a71-4e18-bf1e-7bcb312e6c22 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] [instance: ecd39339-b802-43f3-aba3-432fd6e5387e] Going to try to terminate instance {{(pid=118727) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 19:26:19.188193 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-36a47cd8-0a71-4e18-bf1e-7bcb312e6c22 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ecd39339-b802-43f3-aba3-432fd6e5387e" status: 204 len: 0 microversion: 2.1 time: 0.109096 Oct 31 19:26:19.188779 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 360/721] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 31 19:26:19 2022] DELETE /compute/v2.1/servers/ecd39339-b802-43f3-aba3-432fd6e5387e => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 19:26:19.193676 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-1ea5190d-4f3b-4ff6-9529-273e0280749e tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:26:19.194290 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-1ea5190d-4f3b-4ff6-9529-273e0280749e tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 7a47cd33-e4a0-4b78-9afc-2f371e4a9d10] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:26:19.197562 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-63148211-263d-4457-a5a3-93550b211367 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:26:19.198291 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-63148211-263d-4457-a5a3-93550b211367 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] [instance: ecd39339-b802-43f3-aba3-432fd6e5387e] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:26:19.200416 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-1ea5190d-4f3b-4ff6-9529-273e0280749e tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:19.200948 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-1ea5190d-4f3b-4ff6-9529-273e0280749e tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:19.201420 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-1ea5190d-4f3b-4ff6-9529-273e0280749e tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:19.202345 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-1ea5190d-4f3b-4ff6-9529-273e0280749e tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:19.202808 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-1ea5190d-4f3b-4ff6-9529-273e0280749e tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:19.203235 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-1ea5190d-4f3b-4ff6-9529-273e0280749e tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:19.204324 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-63148211-263d-4457-a5a3-93550b211367 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:19.204816 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-63148211-263d-4457-a5a3-93550b211367 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:19.205282 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-63148211-263d-4457-a5a3-93550b211367 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:19.206222 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-63148211-263d-4457-a5a3-93550b211367 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:19.206685 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-63148211-263d-4457-a5a3-93550b211367 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:19.207167 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-63148211-263d-4457-a5a3-93550b211367 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:19.337346 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-1ea5190d-4f3b-4ff6-9529-273e0280749e tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc49f9eb3114759b2889ed8972136d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cf63c76fc543428404002ae9a75b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:19.341295 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-63148211-263d-4457-a5a3-93550b211367 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b652cca4b94e188b7362606edabb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47ae1789d284a72bb71a6ffe55e7d8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:19.345051 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-1ea5190d-4f3b-4ff6-9529-273e0280749e tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/7a47cd33-e4a0-4b78-9afc-2f371e4a9d10" status: 200 len: 1520 microversion: 2.1 time: 0.156132 Oct 31 19:26:19.345650 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 362/722] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:26:19 2022] GET /compute/v2.1/servers/7a47cd33-e4a0-4b78-9afc-2f371e4a9d10 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 19:26:19.349510 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-63148211-263d-4457-a5a3-93550b211367 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] 10.222.0.16 "GET /compute/v2.1/servers/ecd39339-b802-43f3-aba3-432fd6e5387e" status: 200 len: 1555 microversion: 2.1 time: 0.155852 Oct 31 19:26:19.350179 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 361/723] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:26:19 2022] GET /compute/v2.1/servers/ecd39339-b802-43f3-aba3-432fd6e5387e => generated 1555 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:26:19.495591 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-a05133b7-d334-4f53-ac93-5c6043c0c8e9 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:26:19.496126 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-a05133b7-d334-4f53-ac93-5c6043c0c8e9 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] [instance: fb16e6d4-57d8-4185-9955-ec1d261b365d] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:26:19.501973 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-a05133b7-d334-4f53-ac93-5c6043c0c8e9 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:19.502446 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-a05133b7-d334-4f53-ac93-5c6043c0c8e9 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:19.502878 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-a05133b7-d334-4f53-ac93-5c6043c0c8e9 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:19.503552 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-a05133b7-d334-4f53-ac93-5c6043c0c8e9 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:19.504003 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-a05133b7-d334-4f53-ac93-5c6043c0c8e9 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:19.504424 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-a05133b7-d334-4f53-ac93-5c6043c0c8e9 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:19.577566 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-7432581f-c835-49ed-8d96-8455fd24b29e tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:26:19.578192 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-7432581f-c835-49ed-8d96-8455fd24b29e tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] [instance: c96bdeca-16e0-4d90-a9f9-0f9d46799d68] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:26:19.584874 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-7432581f-c835-49ed-8d96-8455fd24b29e tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:19.585354 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-7432581f-c835-49ed-8d96-8455fd24b29e tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:19.585809 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-7432581f-c835-49ed-8d96-8455fd24b29e tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:19.586544 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-7432581f-c835-49ed-8d96-8455fd24b29e tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:19.586995 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-7432581f-c835-49ed-8d96-8455fd24b29e tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:19.587414 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-7432581f-c835-49ed-8d96-8455fd24b29e tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:19.633022 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-a05133b7-d334-4f53-ac93-5c6043c0c8e9 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5cfee7994ab404d974d86d77e075209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33bb29688304d0dae3cfdc0eb54b7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:19.640692 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-a05133b7-d334-4f53-ac93-5c6043c0c8e9 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] 10.222.0.16 "GET /compute/v2.1/servers/fb16e6d4-57d8-4185-9955-ec1d261b365d" status: 200 len: 1568 microversion: 2.1 time: 0.148921 Oct 31 19:26:19.641255 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 363/724] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:26:19 2022] GET /compute/v2.1/servers/fb16e6d4-57d8-4185-9955-ec1d261b365d => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:26:19.715800 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-7432581f-c835-49ed-8d96-8455fd24b29e tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ece6ca9374764214bac6263bd691bc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9c317b548b40deb8cb27236d36d674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:19.723295 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-7432581f-c835-49ed-8d96-8455fd24b29e tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] 10.222.0.16 "GET /compute/v2.1/servers/c96bdeca-16e0-4d90-a9f9-0f9d46799d68" status: 200 len: 1360 microversion: 2.1 time: 0.149565 Oct 31 19:26:19.723867 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 362/725] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:26:19 2022] GET /compute/v2.1/servers/c96bdeca-16e0-4d90-a9f9-0f9d46799d68 => generated 1360 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 19:26:20.368949 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-0a1f7732-5e7b-45db-a3e0-58c120fa20ac tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:26:20.369552 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-0a1f7732-5e7b-45db-a3e0-58c120fa20ac tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 7a47cd33-e4a0-4b78-9afc-2f371e4a9d10] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:26:20.371919 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-1720c539-1073-4c56-8485-362453b6fa64 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:26:20.372523 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-1720c539-1073-4c56-8485-362453b6fa64 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] [instance: ecd39339-b802-43f3-aba3-432fd6e5387e] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:26:20.376165 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-0a1f7732-5e7b-45db-a3e0-58c120fa20ac tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:20.376640 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-0a1f7732-5e7b-45db-a3e0-58c120fa20ac tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:20.377069 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-0a1f7732-5e7b-45db-a3e0-58c120fa20ac tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:20.377790 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-0a1f7732-5e7b-45db-a3e0-58c120fa20ac tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:20.378239 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-0a1f7732-5e7b-45db-a3e0-58c120fa20ac tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:20.378664 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-0a1f7732-5e7b-45db-a3e0-58c120fa20ac tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:20.378827 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-1720c539-1073-4c56-8485-362453b6fa64 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:20.379289 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-1720c539-1073-4c56-8485-362453b6fa64 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:20.379752 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-1720c539-1073-4c56-8485-362453b6fa64 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:20.380434 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-1720c539-1073-4c56-8485-362453b6fa64 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:20.380883 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-1720c539-1073-4c56-8485-362453b6fa64 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:20.381916 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-1720c539-1073-4c56-8485-362453b6fa64 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:20.510005 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-0a1f7732-5e7b-45db-a3e0-58c120fa20ac tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc49f9eb3114759b2889ed8972136d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cf63c76fc543428404002ae9a75b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:20.510916 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-1720c539-1073-4c56-8485-362453b6fa64 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b652cca4b94e188b7362606edabb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47ae1789d284a72bb71a6ffe55e7d8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:20.517749 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-0a1f7732-5e7b-45db-a3e0-58c120fa20ac tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/7a47cd33-e4a0-4b78-9afc-2f371e4a9d10" status: 200 len: 1520 microversion: 2.1 time: 0.152608 Oct 31 19:26:20.518321 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 364/726] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:26:20 2022] GET /compute/v2.1/servers/7a47cd33-e4a0-4b78-9afc-2f371e4a9d10 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 19:26:20.518516 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-1720c539-1073-4c56-8485-362453b6fa64 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] 10.222.0.16 "GET /compute/v2.1/servers/ecd39339-b802-43f3-aba3-432fd6e5387e" status: 200 len: 1555 microversion: 2.1 time: 0.150323 Oct 31 19:26:20.519141 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 363/727] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:26:20 2022] GET /compute/v2.1/servers/ecd39339-b802-43f3-aba3-432fd6e5387e => generated 1555 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 19:26:20.663115 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-8bf292f0-ed7a-4a67-8498-2307696b4d2f tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:26:20.663659 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-8bf292f0-ed7a-4a67-8498-2307696b4d2f tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] [instance: fb16e6d4-57d8-4185-9955-ec1d261b365d] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:26:20.669837 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-8bf292f0-ed7a-4a67-8498-2307696b4d2f tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:20.670313 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-8bf292f0-ed7a-4a67-8498-2307696b4d2f tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:20.670763 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-8bf292f0-ed7a-4a67-8498-2307696b4d2f tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:20.671440 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-8bf292f0-ed7a-4a67-8498-2307696b4d2f tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:20.671889 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-8bf292f0-ed7a-4a67-8498-2307696b4d2f tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:20.672304 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-8bf292f0-ed7a-4a67-8498-2307696b4d2f tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:20.745498 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-a5ebd550-f0d4-4bcd-b441-fe269454c1f9 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:26:20.746122 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-a5ebd550-f0d4-4bcd-b441-fe269454c1f9 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] [instance: c96bdeca-16e0-4d90-a9f9-0f9d46799d68] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:26:20.752147 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-a5ebd550-f0d4-4bcd-b441-fe269454c1f9 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:20.752633 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-a5ebd550-f0d4-4bcd-b441-fe269454c1f9 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:20.753067 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-a5ebd550-f0d4-4bcd-b441-fe269454c1f9 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:20.753815 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-a5ebd550-f0d4-4bcd-b441-fe269454c1f9 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:20.754279 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-a5ebd550-f0d4-4bcd-b441-fe269454c1f9 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:20.754838 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-a5ebd550-f0d4-4bcd-b441-fe269454c1f9 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:20.770364 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG dbcounter [-] [118727] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:26:20.803889 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-8bf292f0-ed7a-4a67-8498-2307696b4d2f tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5cfee7994ab404d974d86d77e075209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33bb29688304d0dae3cfdc0eb54b7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:20.811528 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-8bf292f0-ed7a-4a67-8498-2307696b4d2f tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] 10.222.0.16 "GET /compute/v2.1/servers/fb16e6d4-57d8-4185-9955-ec1d261b365d" status: 200 len: 1568 microversion: 2.1 time: 0.152212 Oct 31 19:26:20.812093 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 365/728] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:26:20 2022] GET /compute/v2.1/servers/fb16e6d4-57d8-4185-9955-ec1d261b365d => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:26:20.885516 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-a5ebd550-f0d4-4bcd-b441-fe269454c1f9 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ece6ca9374764214bac6263bd691bc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9c317b548b40deb8cb27236d36d674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:20.893005 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-a5ebd550-f0d4-4bcd-b441-fe269454c1f9 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] 10.222.0.16 "GET /compute/v2.1/servers/c96bdeca-16e0-4d90-a9f9-0f9d46799d68" status: 200 len: 1360 microversion: 2.1 time: 0.151354 Oct 31 19:26:20.893562 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 364/729] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:26:20 2022] GET /compute/v2.1/servers/c96bdeca-16e0-4d90-a9f9-0f9d46799d68 => generated 1360 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 19:26:21.541540 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-ff8ac020-1bac-48fa-9469-ad79f7f64688 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:26:21.542186 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-ff8ac020-1bac-48fa-9469-ad79f7f64688 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 7a47cd33-e4a0-4b78-9afc-2f371e4a9d10] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:26:21.542524 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-1da07106-6b74-4a16-bcab-946f8b8c11fa tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:26:21.543182 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-1da07106-6b74-4a16-bcab-946f8b8c11fa tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] [instance: ecd39339-b802-43f3-aba3-432fd6e5387e] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:26:21.548640 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-ff8ac020-1bac-48fa-9469-ad79f7f64688 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:21.549126 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-ff8ac020-1bac-48fa-9469-ad79f7f64688 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:21.549472 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-1da07106-6b74-4a16-bcab-946f8b8c11fa tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:21.549591 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-ff8ac020-1bac-48fa-9469-ad79f7f64688 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:21.550008 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-1da07106-6b74-4a16-bcab-946f8b8c11fa tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:21.550270 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-ff8ac020-1bac-48fa-9469-ad79f7f64688 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:21.550442 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-1da07106-6b74-4a16-bcab-946f8b8c11fa tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:21.550729 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-ff8ac020-1bac-48fa-9469-ad79f7f64688 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:21.551119 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-1da07106-6b74-4a16-bcab-946f8b8c11fa tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:21.551239 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-ff8ac020-1bac-48fa-9469-ad79f7f64688 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:21.552306 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-1da07106-6b74-4a16-bcab-946f8b8c11fa tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:21.553180 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-1da07106-6b74-4a16-bcab-946f8b8c11fa tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:21.682941 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-ff8ac020-1bac-48fa-9469-ad79f7f64688 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc49f9eb3114759b2889ed8972136d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cf63c76fc543428404002ae9a75b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:21.683292 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-1da07106-6b74-4a16-bcab-946f8b8c11fa tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b652cca4b94e188b7362606edabb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47ae1789d284a72bb71a6ffe55e7d8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:21.690763 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-ff8ac020-1bac-48fa-9469-ad79f7f64688 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/7a47cd33-e4a0-4b78-9afc-2f371e4a9d10" status: 200 len: 1520 microversion: 2.1 time: 0.153352 Oct 31 19:26:21.690944 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-1da07106-6b74-4a16-bcab-946f8b8c11fa tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] 10.222.0.16 "GET /compute/v2.1/servers/ecd39339-b802-43f3-aba3-432fd6e5387e" status: 200 len: 1555 microversion: 2.1 time: 0.152411 Oct 31 19:26:21.691335 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 366/730] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:26:21 2022] GET /compute/v2.1/servers/7a47cd33-e4a0-4b78-9afc-2f371e4a9d10 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:26:21.691757 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 365/731] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:26:21 2022] GET /compute/v2.1/servers/ecd39339-b802-43f3-aba3-432fd6e5387e => generated 1555 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 19:26:21.834312 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-fb958a8a-db3f-4a33-a72d-76d2e6e379ac tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:26:21.834909 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-fb958a8a-db3f-4a33-a72d-76d2e6e379ac tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] [instance: fb16e6d4-57d8-4185-9955-ec1d261b365d] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:26:21.840720 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-fb958a8a-db3f-4a33-a72d-76d2e6e379ac tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:21.841194 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-fb958a8a-db3f-4a33-a72d-76d2e6e379ac tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:21.841668 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-fb958a8a-db3f-4a33-a72d-76d2e6e379ac tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:21.842344 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-fb958a8a-db3f-4a33-a72d-76d2e6e379ac tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:21.842795 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-fb958a8a-db3f-4a33-a72d-76d2e6e379ac tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:21.843215 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-fb958a8a-db3f-4a33-a72d-76d2e6e379ac tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:21.916480 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-c9b70537-0d6a-4e22-9a0d-e1394d8d80e9 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:26:21.917232 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-c9b70537-0d6a-4e22-9a0d-e1394d8d80e9 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] [instance: c96bdeca-16e0-4d90-a9f9-0f9d46799d68] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:26:21.923344 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-c9b70537-0d6a-4e22-9a0d-e1394d8d80e9 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:21.923826 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-c9b70537-0d6a-4e22-9a0d-e1394d8d80e9 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:21.924287 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-c9b70537-0d6a-4e22-9a0d-e1394d8d80e9 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:21.924973 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-c9b70537-0d6a-4e22-9a0d-e1394d8d80e9 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:21.925430 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-c9b70537-0d6a-4e22-9a0d-e1394d8d80e9 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:21.925877 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-c9b70537-0d6a-4e22-9a0d-e1394d8d80e9 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:21.970620 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-fb958a8a-db3f-4a33-a72d-76d2e6e379ac tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5cfee7994ab404d974d86d77e075209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33bb29688304d0dae3cfdc0eb54b7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:21.978864 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-fb958a8a-db3f-4a33-a72d-76d2e6e379ac tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] 10.222.0.16 "GET /compute/v2.1/servers/fb16e6d4-57d8-4185-9955-ec1d261b365d" status: 200 len: 1568 microversion: 2.1 time: 0.148358 Oct 31 19:26:21.979436 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 367/732] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:26:21 2022] GET /compute/v2.1/servers/fb16e6d4-57d8-4185-9955-ec1d261b365d => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:26:22.053858 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-c9b70537-0d6a-4e22-9a0d-e1394d8d80e9 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ece6ca9374764214bac6263bd691bc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9c317b548b40deb8cb27236d36d674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:22.061421 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-c9b70537-0d6a-4e22-9a0d-e1394d8d80e9 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] 10.222.0.16 "GET /compute/v2.1/servers/c96bdeca-16e0-4d90-a9f9-0f9d46799d68" status: 200 len: 1360 microversion: 2.1 time: 0.149081 Oct 31 19:26:22.062006 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 366/733] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:26:21 2022] GET /compute/v2.1/servers/c96bdeca-16e0-4d90-a9f9-0f9d46799d68 => generated 1360 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 19:26:22.715370 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-75b7a4f9-e4f4-4f12-b287-d9a3965bf791 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:26:22.716207 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-264929e6-42e0-4ab4-8167-011f828dca97 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:26:22.716973 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-264929e6-42e0-4ab4-8167-011f828dca97 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 7a47cd33-e4a0-4b78-9afc-2f371e4a9d10] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:26:22.717326 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-75b7a4f9-e4f4-4f12-b287-d9a3965bf791 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] [instance: ecd39339-b802-43f3-aba3-432fd6e5387e] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:26:22.724582 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-75b7a4f9-e4f4-4f12-b287-d9a3965bf791 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:22.725060 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-75b7a4f9-e4f4-4f12-b287-d9a3965bf791 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:22.725832 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-75b7a4f9-e4f4-4f12-b287-d9a3965bf791 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:22.726867 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-75b7a4f9-e4f4-4f12-b287-d9a3965bf791 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:22.727121 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-264929e6-42e0-4ab4-8167-011f828dca97 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:22.727816 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-75b7a4f9-e4f4-4f12-b287-d9a3965bf791 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:22.727941 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-264929e6-42e0-4ab4-8167-011f828dca97 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:22.728306 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-264929e6-42e0-4ab4-8167-011f828dca97 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:22.728849 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-75b7a4f9-e4f4-4f12-b287-d9a3965bf791 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:22.729032 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-264929e6-42e0-4ab4-8167-011f828dca97 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:22.730453 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-264929e6-42e0-4ab4-8167-011f828dca97 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:22.730908 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-264929e6-42e0-4ab4-8167-011f828dca97 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:23.063134 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-264929e6-42e0-4ab4-8167-011f828dca97 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc49f9eb3114759b2889ed8972136d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cf63c76fc543428404002ae9a75b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:23.074435 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-264929e6-42e0-4ab4-8167-011f828dca97 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/7a47cd33-e4a0-4b78-9afc-2f371e4a9d10" status: 200 len: 1520 microversion: 2.1 time: 0.362507 Oct 31 19:26:23.075012 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 367/734] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:26:22 2022] GET /compute/v2.1/servers/7a47cd33-e4a0-4b78-9afc-2f371e4a9d10 => generated 1520 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:26:23.083683 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-3c08659d-d0bb-46e7-83fd-650f4b9f0448 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:26:23.083683 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-3c08659d-d0bb-46e7-83fd-650f4b9f0448 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] [instance: fb16e6d4-57d8-4185-9955-ec1d261b365d] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:26:23.088120 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-3c08659d-d0bb-46e7-83fd-650f4b9f0448 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:23.088599 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-3c08659d-d0bb-46e7-83fd-650f4b9f0448 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:23.089025 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-3c08659d-d0bb-46e7-83fd-650f4b9f0448 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:23.089732 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-3c08659d-d0bb-46e7-83fd-650f4b9f0448 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:23.090180 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-3c08659d-d0bb-46e7-83fd-650f4b9f0448 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:23.090588 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-3c08659d-d0bb-46e7-83fd-650f4b9f0448 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:23.102757 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-75b7a4f9-e4f4-4f12-b287-d9a3965bf791 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b652cca4b94e188b7362606edabb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47ae1789d284a72bb71a6ffe55e7d8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:23.111239 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-75b7a4f9-e4f4-4f12-b287-d9a3965bf791 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] 10.222.0.16 "GET /compute/v2.1/servers/ecd39339-b802-43f3-aba3-432fd6e5387e" status: 200 len: 1513 microversion: 2.1 time: 0.399646 Oct 31 19:26:23.119536 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 368/735] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:26:22 2022] GET /compute/v2.1/servers/ecd39339-b802-43f3-aba3-432fd6e5387e => generated 1513 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:26:23.125003 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-798b6011-518a-43c3-b53b-1b7d04106ae6 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:26:23.125971 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-798b6011-518a-43c3-b53b-1b7d04106ae6 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] [instance: c96bdeca-16e0-4d90-a9f9-0f9d46799d68] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:26:23.137570 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-798b6011-518a-43c3-b53b-1b7d04106ae6 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:23.138164 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-798b6011-518a-43c3-b53b-1b7d04106ae6 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:23.138668 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-798b6011-518a-43c3-b53b-1b7d04106ae6 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:23.139440 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-798b6011-518a-43c3-b53b-1b7d04106ae6 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:23.139961 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-798b6011-518a-43c3-b53b-1b7d04106ae6 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:23.140453 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-798b6011-518a-43c3-b53b-1b7d04106ae6 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:23.312639 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-798b6011-518a-43c3-b53b-1b7d04106ae6 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ece6ca9374764214bac6263bd691bc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9c317b548b40deb8cb27236d36d674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:23.321035 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-798b6011-518a-43c3-b53b-1b7d04106ae6 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] 10.222.0.16 "GET /compute/v2.1/servers/c96bdeca-16e0-4d90-a9f9-0f9d46799d68" status: 200 len: 1360 microversion: 2.1 time: 0.199952 Oct 31 19:26:23.336276 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 369/736] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:26:23 2022] GET /compute/v2.1/servers/c96bdeca-16e0-4d90-a9f9-0f9d46799d68 => generated 1360 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:26:23.406266 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [req-ad812c1b-1601-4443-9470-9e2cb6f7bf22 req-bb997926-479a-4ead-b187-381d4c6ca74b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecd39339-b802-43f3-aba3-432fd6e5387e", "name": "network-vif-deleted", "tag": "02358090-76d2-46a6-9956-91d3a84a985a"}]} {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:26:23.416271 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [req-ad812c1b-1601-4443-9470-9e2cb6f7bf22 req-bb997926-479a-4ead-b187-381d4c6ca74b service nova] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:23.416745 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [req-ad812c1b-1601-4443-9470-9e2cb6f7bf22 req-bb997926-479a-4ead-b187-381d4c6ca74b service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:23.417168 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [req-ad812c1b-1601-4443-9470-9e2cb6f7bf22 req-bb997926-479a-4ead-b187-381d4c6ca74b service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:23.418370 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-3c08659d-d0bb-46e7-83fd-650f4b9f0448 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5cfee7994ab404d974d86d77e075209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33bb29688304d0dae3cfdc0eb54b7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:23.428066 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-3c08659d-d0bb-46e7-83fd-650f4b9f0448 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] 10.222.0.16 "GET /compute/v2.1/servers/fb16e6d4-57d8-4185-9955-ec1d261b365d" status: 200 len: 1568 microversion: 2.1 time: 0.352064 Oct 31 19:26:23.429657 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 368/737] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:26:23 2022] GET /compute/v2.1/servers/fb16e6d4-57d8-4185-9955-ec1d261b365d => generated 1568 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:26:23.430253 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.compute.server_external_events [req-ad812c1b-1601-4443-9470-9e2cb6f7bf22 req-bb997926-479a-4ead-b187-381d4c6ca74b service nova] Creating event network-vif-deleted:02358090-76d2-46a6-9956-91d3a84a985a for instance ecd39339-b802-43f3-aba3-432fd6e5387e on hv-cinder-86309 Oct 31 19:26:23.440726 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [req-ad812c1b-1601-4443-9470-9e2cb6f7bf22 req-bb997926-479a-4ead-b187-381d4c6ca74b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102797 Oct 31 19:26:23.441402 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 370/738] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 31 19:26:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:26:23.544484 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [req-6ff634bf-f359-4224-ab70-e6eee6b9eb12 req-36111295-2509-4a85-bda5-14d630f56875 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a47cd33-e4a0-4b78-9afc-2f371e4a9d10", "name": "network-vif-deleted", "tag": "c1f5b141-b428-4cbf-9938-2df49ece4368"}]} {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:26:23.555471 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [req-6ff634bf-f359-4224-ab70-e6eee6b9eb12 req-36111295-2509-4a85-bda5-14d630f56875 service nova] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:23.556167 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [req-6ff634bf-f359-4224-ab70-e6eee6b9eb12 req-36111295-2509-4a85-bda5-14d630f56875 service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:23.556371 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [req-6ff634bf-f359-4224-ab70-e6eee6b9eb12 req-36111295-2509-4a85-bda5-14d630f56875 service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:23.568247 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.compute.server_external_events [req-6ff634bf-f359-4224-ab70-e6eee6b9eb12 req-36111295-2509-4a85-bda5-14d630f56875 service nova] Creating event network-vif-deleted:c1f5b141-b428-4cbf-9938-2df49ece4368 for instance 7a47cd33-e4a0-4b78-9afc-2f371e4a9d10 on hv-cinder-86309 Oct 31 19:26:23.573315 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [req-6ff634bf-f359-4224-ab70-e6eee6b9eb12 req-36111295-2509-4a85-bda5-14d630f56875 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032941 Oct 31 19:26:23.574209 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 369/739] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 31 19:26:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 19:26:24.105808 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-2f7a81bf-7b48-40ee-b33c-e6fd7cc5c3d1 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:26:24.106471 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-2f7a81bf-7b48-40ee-b33c-e6fd7cc5c3d1 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 7a47cd33-e4a0-4b78-9afc-2f371e4a9d10] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:26:24.112605 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-2f7a81bf-7b48-40ee-b33c-e6fd7cc5c3d1 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:24.113082 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-2f7a81bf-7b48-40ee-b33c-e6fd7cc5c3d1 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:24.113509 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-2f7a81bf-7b48-40ee-b33c-e6fd7cc5c3d1 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:24.114812 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-2f7a81bf-7b48-40ee-b33c-e6fd7cc5c3d1 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:24.115267 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-2f7a81bf-7b48-40ee-b33c-e6fd7cc5c3d1 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:24.115688 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-2f7a81bf-7b48-40ee-b33c-e6fd7cc5c3d1 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:24.135526 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-c1c70b52-c8fc-450b-8254-ff9bd789415b tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:26:24.136139 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-c1c70b52-c8fc-450b-8254-ff9bd789415b tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] [instance: ecd39339-b802-43f3-aba3-432fd6e5387e] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:26:24.142356 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-c1c70b52-c8fc-450b-8254-ff9bd789415b tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:24.142848 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-c1c70b52-c8fc-450b-8254-ff9bd789415b tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:24.143273 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-c1c70b52-c8fc-450b-8254-ff9bd789415b tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:24.143966 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-c1c70b52-c8fc-450b-8254-ff9bd789415b tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:24.144413 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-c1c70b52-c8fc-450b-8254-ff9bd789415b tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:24.144830 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-c1c70b52-c8fc-450b-8254-ff9bd789415b tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:24.147480 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-2f7a81bf-7b48-40ee-b33c-e6fd7cc5c3d1 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:24.147960 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-2f7a81bf-7b48-40ee-b33c-e6fd7cc5c3d1 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:24.148388 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-2f7a81bf-7b48-40ee-b33c-e6fd7cc5c3d1 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:24.148823 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.objects.instance [None req-2f7a81bf-7b48-40ee-b33c-e6fd7cc5c3d1 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lazy-loading 'fault' on Instance uuid 7a47cd33-e4a0-4b78-9afc-2f371e4a9d10 {{(pid=118726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 19:26:24.176977 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-c1c70b52-c8fc-450b-8254-ff9bd789415b tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:24.177446 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-c1c70b52-c8fc-450b-8254-ff9bd789415b tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:24.177891 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-c1c70b52-c8fc-450b-8254-ff9bd789415b tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:24.178329 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.objects.instance [None req-c1c70b52-c8fc-450b-8254-ff9bd789415b tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lazy-loading 'fault' on Instance uuid ecd39339-b802-43f3-aba3-432fd6e5387e {{(pid=118727) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 19:26:24.195860 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-2f7a81bf-7b48-40ee-b33c-e6fd7cc5c3d1 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc49f9eb3114759b2889ed8972136d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cf63c76fc543428404002ae9a75b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:24.206562 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-2f7a81bf-7b48-40ee-b33c-e6fd7cc5c3d1 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/7a47cd33-e4a0-4b78-9afc-2f371e4a9d10" status: 200 len: 1311 microversion: 2.1 time: 0.105263 Oct 31 19:26:24.208448 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 371/740] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:26:24 2022] GET /compute/v2.1/servers/7a47cd33-e4a0-4b78-9afc-2f371e4a9d10 => generated 1311 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:26:24.244655 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-c1c70b52-c8fc-450b-8254-ff9bd789415b tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b652cca4b94e188b7362606edabb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47ae1789d284a72bb71a6ffe55e7d8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:24.255085 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-c1c70b52-c8fc-450b-8254-ff9bd789415b tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] 10.222.0.16 "GET /compute/v2.1/servers/ecd39339-b802-43f3-aba3-432fd6e5387e" status: 200 len: 1348 microversion: 2.1 time: 0.124365 Oct 31 19:26:24.255812 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 370/741] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:26:24 2022] GET /compute/v2.1/servers/ecd39339-b802-43f3-aba3-432fd6e5387e => generated 1348 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:26:24.343593 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-e641a53c-0946-492b-94bb-b3ab6d5b1982 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:26:24.344202 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-e641a53c-0946-492b-94bb-b3ab6d5b1982 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] [instance: c96bdeca-16e0-4d90-a9f9-0f9d46799d68] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:26:24.350686 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-e641a53c-0946-492b-94bb-b3ab6d5b1982 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:24.351162 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-e641a53c-0946-492b-94bb-b3ab6d5b1982 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:24.351596 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-e641a53c-0946-492b-94bb-b3ab6d5b1982 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:24.352306 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-e641a53c-0946-492b-94bb-b3ab6d5b1982 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:24.352754 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-e641a53c-0946-492b-94bb-b3ab6d5b1982 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:24.353175 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-e641a53c-0946-492b-94bb-b3ab6d5b1982 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:24.454483 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-2153dcf3-5704-4f81-a268-d3834a837b4f tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:26:24.455104 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-2153dcf3-5704-4f81-a268-d3834a837b4f tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] [instance: fb16e6d4-57d8-4185-9955-ec1d261b365d] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:26:24.461523 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-2153dcf3-5704-4f81-a268-d3834a837b4f tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:24.462133 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-2153dcf3-5704-4f81-a268-d3834a837b4f tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:24.462561 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-2153dcf3-5704-4f81-a268-d3834a837b4f tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:24.463246 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-2153dcf3-5704-4f81-a268-d3834a837b4f tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:24.463694 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-2153dcf3-5704-4f81-a268-d3834a837b4f tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:24.464109 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-2153dcf3-5704-4f81-a268-d3834a837b4f tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:24.477993 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-e641a53c-0946-492b-94bb-b3ab6d5b1982 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ece6ca9374764214bac6263bd691bc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9c317b548b40deb8cb27236d36d674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:24.485765 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-e641a53c-0946-492b-94bb-b3ab6d5b1982 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] 10.222.0.16 "GET /compute/v2.1/servers/c96bdeca-16e0-4d90-a9f9-0f9d46799d68" status: 200 len: 1545 microversion: 2.1 time: 0.145952 Oct 31 19:26:24.486351 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 372/742] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:26:24 2022] GET /compute/v2.1/servers/c96bdeca-16e0-4d90-a9f9-0f9d46799d68 => generated 1545 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:26:24.508463 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-29a577dd-f03d-4eef-aa0a-fa1a03104c79 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:26:24.508959 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-29a577dd-f03d-4eef-aa0a-fa1a03104c79 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] [instance: c96bdeca-16e0-4d90-a9f9-0f9d46799d68] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:26:24.514788 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-29a577dd-f03d-4eef-aa0a-fa1a03104c79 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:24.515267 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-29a577dd-f03d-4eef-aa0a-fa1a03104c79 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:24.515700 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-29a577dd-f03d-4eef-aa0a-fa1a03104c79 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:24.516385 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-29a577dd-f03d-4eef-aa0a-fa1a03104c79 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:24.516835 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-29a577dd-f03d-4eef-aa0a-fa1a03104c79 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:24.517256 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-29a577dd-f03d-4eef-aa0a-fa1a03104c79 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:24.595220 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-29a577dd-f03d-4eef-aa0a-fa1a03104c79 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] 10.222.0.16 "GET /compute/v2.1/servers/c96bdeca-16e0-4d90-a9f9-0f9d46799d68/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091021 Oct 31 19:26:24.595852 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 373/743] 10.222.0.16 () {58 vars in 1275 bytes} [Mon Oct 31 19:26:24 2022] GET /compute/v2.1/servers/c96bdeca-16e0-4d90-a9f9-0f9d46799d68/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 19:26:24.599733 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-2153dcf3-5704-4f81-a268-d3834a837b4f tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5cfee7994ab404d974d86d77e075209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33bb29688304d0dae3cfdc0eb54b7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:24.608335 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-2153dcf3-5704-4f81-a268-d3834a837b4f tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] 10.222.0.16 "GET /compute/v2.1/servers/fb16e6d4-57d8-4185-9955-ec1d261b365d" status: 200 len: 1568 microversion: 2.1 time: 0.157520 Oct 31 19:26:24.613719 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 371/744] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:26:24 2022] GET /compute/v2.1/servers/fb16e6d4-57d8-4185-9955-ec1d261b365d => generated 1568 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 19:26:25.230931 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-50f2a022-92c8-4f64-8d4c-b84a25a236bd tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:26:25.231548 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-50f2a022-92c8-4f64-8d4c-b84a25a236bd tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 7a47cd33-e4a0-4b78-9afc-2f371e4a9d10] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:26:25.237564 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-50f2a022-92c8-4f64-8d4c-b84a25a236bd tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:25.238074 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-50f2a022-92c8-4f64-8d4c-b84a25a236bd tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:25.238510 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-50f2a022-92c8-4f64-8d4c-b84a25a236bd tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:25.239197 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-50f2a022-92c8-4f64-8d4c-b84a25a236bd tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:25.239654 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-50f2a022-92c8-4f64-8d4c-b84a25a236bd tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:25.240075 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-50f2a022-92c8-4f64-8d4c-b84a25a236bd tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:25.271681 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-50f2a022-92c8-4f64-8d4c-b84a25a236bd tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:25.272170 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-50f2a022-92c8-4f64-8d4c-b84a25a236bd tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:25.272604 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-50f2a022-92c8-4f64-8d4c-b84a25a236bd tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:25.273044 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.objects.instance [None req-50f2a022-92c8-4f64-8d4c-b84a25a236bd tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lazy-loading 'fault' on Instance uuid 7a47cd33-e4a0-4b78-9afc-2f371e4a9d10 {{(pid=118726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 19:26:25.280028 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-a07835e0-a8b5-48d0-9826-ce15802e364d tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:26:25.280638 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-a07835e0-a8b5-48d0-9826-ce15802e364d tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] [instance: ecd39339-b802-43f3-aba3-432fd6e5387e] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:26:25.287263 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-a07835e0-a8b5-48d0-9826-ce15802e364d tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:25.287750 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-a07835e0-a8b5-48d0-9826-ce15802e364d tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:25.288178 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-a07835e0-a8b5-48d0-9826-ce15802e364d tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:25.288864 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-a07835e0-a8b5-48d0-9826-ce15802e364d tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:25.289316 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-a07835e0-a8b5-48d0-9826-ce15802e364d tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:25.289771 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-a07835e0-a8b5-48d0-9826-ce15802e364d tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:25.320480 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-a07835e0-a8b5-48d0-9826-ce15802e364d tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:25.321154 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-a07835e0-a8b5-48d0-9826-ce15802e364d tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:25.321599 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-a07835e0-a8b5-48d0-9826-ce15802e364d tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:25.321851 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-50f2a022-92c8-4f64-8d4c-b84a25a236bd tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc49f9eb3114759b2889ed8972136d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cf63c76fc543428404002ae9a75b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:25.322064 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.objects.instance [None req-a07835e0-a8b5-48d0-9826-ce15802e364d tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lazy-loading 'fault' on Instance uuid ecd39339-b802-43f3-aba3-432fd6e5387e {{(pid=118727) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 19:26:25.330829 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-50f2a022-92c8-4f64-8d4c-b84a25a236bd tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/7a47cd33-e4a0-4b78-9afc-2f371e4a9d10" status: 200 len: 1311 microversion: 2.1 time: 0.104275 Oct 31 19:26:25.331406 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 374/745] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:26:25 2022] GET /compute/v2.1/servers/7a47cd33-e4a0-4b78-9afc-2f371e4a9d10 => generated 1311 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:26:25.365501 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-a07835e0-a8b5-48d0-9826-ce15802e364d tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b652cca4b94e188b7362606edabb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47ae1789d284a72bb71a6ffe55e7d8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:25.373262 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-a07835e0-a8b5-48d0-9826-ce15802e364d tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] 10.222.0.16 "GET /compute/v2.1/servers/ecd39339-b802-43f3-aba3-432fd6e5387e" status: 200 len: 1348 microversion: 2.1 time: 0.097260 Oct 31 19:26:25.373952 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 372/746] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:26:25 2022] GET /compute/v2.1/servers/ecd39339-b802-43f3-aba3-432fd6e5387e => generated 1348 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 19:26:25.563696 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [req-b9f10e74-9cc7-431d-867e-bdb3470a23d4 req-0996ffc2-ec94-4b92-8ce2-cf6b0ce75731 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c96bdeca-16e0-4d90-a9f9-0f9d46799d68", "tag": "6abee1f4-a65e-4f4f-9235-4bfd378d8389"}]} {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:26:25.572942 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [req-b9f10e74-9cc7-431d-867e-bdb3470a23d4 req-0996ffc2-ec94-4b92-8ce2-cf6b0ce75731 service nova] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:25.573409 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [req-b9f10e74-9cc7-431d-867e-bdb3470a23d4 req-0996ffc2-ec94-4b92-8ce2-cf6b0ce75731 service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:25.573853 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [req-b9f10e74-9cc7-431d-867e-bdb3470a23d4 req-0996ffc2-ec94-4b92-8ce2-cf6b0ce75731 service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:25.584758 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.compute.server_external_events [req-b9f10e74-9cc7-431d-867e-bdb3470a23d4 req-0996ffc2-ec94-4b92-8ce2-cf6b0ce75731 service nova] Creating event network-changed:6abee1f4-a65e-4f4f-9235-4bfd378d8389 for instance c96bdeca-16e0-4d90-a9f9-0f9d46799d68 on hv-cinder-86309 Oct 31 19:26:25.589687 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [req-b9f10e74-9cc7-431d-867e-bdb3470a23d4 req-0996ffc2-ec94-4b92-8ce2-cf6b0ce75731 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029632 Oct 31 19:26:25.590274 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 375/747] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 31 19:26:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:26:25.631763 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-7f078a26-847f-4fa6-b075-a00c84a3885f tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:26:25.632497 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-7f078a26-847f-4fa6-b075-a00c84a3885f tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] [instance: fb16e6d4-57d8-4185-9955-ec1d261b365d] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:26:25.638431 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-7f078a26-847f-4fa6-b075-a00c84a3885f tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:25.638909 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-7f078a26-847f-4fa6-b075-a00c84a3885f tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:25.639341 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-7f078a26-847f-4fa6-b075-a00c84a3885f tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:25.640037 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-7f078a26-847f-4fa6-b075-a00c84a3885f tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:25.640467 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-7f078a26-847f-4fa6-b075-a00c84a3885f tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:25.640891 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-7f078a26-847f-4fa6-b075-a00c84a3885f tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:25.778432 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-7f078a26-847f-4fa6-b075-a00c84a3885f tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5cfee7994ab404d974d86d77e075209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33bb29688304d0dae3cfdc0eb54b7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:25.786702 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-7f078a26-847f-4fa6-b075-a00c84a3885f tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] 10.222.0.16 "GET /compute/v2.1/servers/fb16e6d4-57d8-4185-9955-ec1d261b365d" status: 200 len: 1568 microversion: 2.1 time: 0.158871 Oct 31 19:26:25.787278 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 373/748] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:26:25 2022] GET /compute/v2.1/servers/fb16e6d4-57d8-4185-9955-ec1d261b365d => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:26:26.353370 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-e374df29-bb47-486c-985c-2f0a25edd5c0 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:26:26.354084 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-e374df29-bb47-486c-985c-2f0a25edd5c0 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 7a47cd33-e4a0-4b78-9afc-2f371e4a9d10] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:26:26.360780 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-e374df29-bb47-486c-985c-2f0a25edd5c0 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:26.361260 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-e374df29-bb47-486c-985c-2f0a25edd5c0 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:26.361719 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-e374df29-bb47-486c-985c-2f0a25edd5c0 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:26.362410 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-e374df29-bb47-486c-985c-2f0a25edd5c0 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:26.362863 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-e374df29-bb47-486c-985c-2f0a25edd5c0 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:26.363283 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-e374df29-bb47-486c-985c-2f0a25edd5c0 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:26.402133 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-e374df29-bb47-486c-985c-2f0a25edd5c0 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:26.402845 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-e374df29-bb47-486c-985c-2f0a25edd5c0 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:26.403438 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-e374df29-bb47-486c-985c-2f0a25edd5c0 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:26.404035 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.objects.instance [None req-e374df29-bb47-486c-985c-2f0a25edd5c0 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lazy-loading 'fault' on Instance uuid 7a47cd33-e4a0-4b78-9afc-2f371e4a9d10 {{(pid=118726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 19:26:26.404791 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-6dd1ed55-23c3-46ef-b1f8-0f33ba482d05 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:26:26.405436 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-6dd1ed55-23c3-46ef-b1f8-0f33ba482d05 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] [instance: ecd39339-b802-43f3-aba3-432fd6e5387e] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:26:26.411254 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG dbcounter [-] [118726] Writing DB stats nova_cell1:SELECT=100 {{(pid=118726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:26:26.425732 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-6dd1ed55-23c3-46ef-b1f8-0f33ba482d05 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:26.429036 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-6dd1ed55-23c3-46ef-b1f8-0f33ba482d05 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:26.429487 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-6dd1ed55-23c3-46ef-b1f8-0f33ba482d05 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:26.434674 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-6dd1ed55-23c3-46ef-b1f8-0f33ba482d05 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:26.435212 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-6dd1ed55-23c3-46ef-b1f8-0f33ba482d05 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:26.435653 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-6dd1ed55-23c3-46ef-b1f8-0f33ba482d05 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:26.475800 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.wsgi [None req-6dd1ed55-23c3-46ef-b1f8-0f33ba482d05 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] HTTP exception thrown: Instance ecd39339-b802-43f3-aba3-432fd6e5387e could not be found. Oct 31 19:26:26.477076 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-6dd1ed55-23c3-46ef-b1f8-0f33ba482d05 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Request method failure captured: Oct 31 19:26:26.477076 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: request: GET /compute/v2.1/servers/ecd39339-b802-43f3-aba3-432fd6e5387e HTTP/1.1 Oct 31 19:26:26.477076 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Accept: application/json Oct 31 19:26:26.477076 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Accept-Encoding: identity Oct 31 19:26:26.477076 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Connection: close Oct 31 19:26:26.477076 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Content-Length: 0 Oct 31 19:26:26.477076 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Content-Type: application/json Oct 31 19:26:26.477076 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Host: 10.222.0.16 Oct 31 19:26:26.477076 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Openstack-System-Scope: None Oct 31 19:26:26.477076 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: User-Agent: python-urllib3/1.26.12 Oct 31 19:26:26.477076 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Auth-Token: gAAAAABjYCB7GBzR8vO7CDMfQCRZdoyE1Gx8gra7aSq_I_aSPvne4QDaF1OxwapHSnUj0aYt8N2C6VCiZ-7PFtEt3Bl-4c83A_8lKxqH_-56yRDPQKH4dQfNHHF4hIqCb4PgYfcKVJmH1bbhIvqrhWrpovSJNclpM0It-g-okFeY697dYkjoTfE Oct 31 19:26:26.477076 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Domain-Id: None Oct 31 19:26:26.477076 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Domain-Name: None Oct 31 19:26:26.477076 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Identity-Status: Confirmed Oct 31 19:26:26.477076 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Is-Admin-Project: True Oct 31 19:26:26.477076 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Project-Domain-Id: default Oct 31 19:26:26.477076 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Project-Domain-Name: Default Oct 31 19:26:26.477076 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Project-Id: c47ae1789d284a72bb71a6ffe55e7d8b Oct 31 19:26:26.477076 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Project-Name: tempest-TestMinimumBasicScenario-1687534068 Oct 31 19:26:26.477076 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Role: member,reader Oct 31 19:26:26.477076 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Roles: member,reader Oct 31 19:26:26.478705 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c47ae1789d284a72bb71a6ffe55e7d8b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c47ae1789d284a72bb71a6ffe55e7d8b", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c47ae1789d284a72bb71a6ffe55e7d8b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c47ae1789d284a72bb71a6ffe55e7d8b"}]}] Oct 31 19:26:26.478705 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Tenant: tempest-TestMinimumBasicScenario-1687534068 Oct 31 19:26:26.478705 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Tenant-Id: c47ae1789d284a72bb71a6ffe55e7d8b Oct 31 19:26:26.478705 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1687534068 Oct 31 19:26:26.478705 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User: tempest-TestMinimumBasicScenario-1687534068-project Oct 31 19:26:26.478705 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User-Domain-Id: default Oct 31 19:26:26.478705 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User-Domain-Name: Default Oct 31 19:26:26.478705 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User-Id: 34b652cca4b94e188b7362606edabb30 Oct 31 19:26:26.478705 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User-Name: tempest-TestMinimumBasicScenario-1687534068-project Oct 31 19:26:26.478705 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: method: > Oct 31 19:26:26.478705 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: exception: Instance ecd39339-b802-43f3-aba3-432fd6e5387e could not be found. Oct 31 19:26:26.478705 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: action_args: {'id': 'ecd39339-b802-43f3-aba3-432fd6e5387e'} Oct 31 19:26:26.479999 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 19:26:26.479999 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:26:26.479999 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 19:26:26.479999 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 19:26:26.479999 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 19:26:26.479999 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 19:26:26.479999 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 19:26:26.479999 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 19:26:26.479999 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 19:26:26.479999 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 19:26:26.479999 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ecd39339-b802-43f3-aba3-432fd6e5387e could not be found. Oct 31 19:26:26.479999 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:26:26.479999 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 19:26:26.479999 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:26:26.479999 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:26:26.479999 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 19:26:26.479999 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 19:26:26.479999 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 19:26:26.479999 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 19:26:26.479999 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 19:26:26.481448 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 19:26:26.481448 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 19:26:26.481448 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 19:26:26.481448 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 19:26:26.481448 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 19:26:26.481448 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 19:26:26.481448 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 19:26:26.481448 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ecd39339-b802-43f3-aba3-432fd6e5387e could not be found. Oct 31 19:26:26.481448 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:26:26.481448 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 19:26:26.481448 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:26:26.481448 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:26:26.481448 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 19:26:26.481448 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 19:26:26.481448 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 19:26:26.481448 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 19:26:26.481448 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ecd39339-b802-43f3-aba3-432fd6e5387e could not be found. Oct 31 19:26:26.481448 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:26:26.483180 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-e374df29-bb47-486c-985c-2f0a25edd5c0 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc49f9eb3114759b2889ed8972136d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cf63c76fc543428404002ae9a75b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:26.490597 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-6dd1ed55-23c3-46ef-b1f8-0f33ba482d05 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Returning 404 to user: Instance ecd39339-b802-43f3-aba3-432fd6e5387e could not be found. {{(pid=118727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 19:26:26.492856 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-6dd1ed55-23c3-46ef-b1f8-0f33ba482d05 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] 10.222.0.16 "GET /compute/v2.1/servers/ecd39339-b802-43f3-aba3-432fd6e5387e" status: 404 len: 111 microversion: 2.1 time: 0.098995 Oct 31 19:26:26.494117 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 374/749] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:26:26 2022] GET /compute/v2.1/servers/ecd39339-b802-43f3-aba3-432fd6e5387e => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 19:26:26.498033 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-e374df29-bb47-486c-985c-2f0a25edd5c0 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/7a47cd33-e4a0-4b78-9afc-2f371e4a9d10" status: 200 len: 1311 microversion: 2.1 time: 0.144813 Oct 31 19:26:26.512357 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 376/750] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:26:26 2022] GET /compute/v2.1/servers/7a47cd33-e4a0-4b78-9afc-2f371e4a9d10 => generated 1311 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:26:26.513716 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-58dff130-245c-45a3-9d58-a399e16e1040 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] Calling method '.version_select at 0x7f34f206fa60>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:26:26.545872 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-58dff130-245c-45a3-9d58-a399e16e1040 tempest-TestMinimumBasicScenario-1687534068 tempest-TestMinimumBasicScenario-1687534068-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-916769467" status: 202 len: 0 microversion: 2.1 time: 0.045653 Oct 31 19:26:26.554666 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 375/751] 10.222.0.16 () {58 vars in 1269 bytes} [Mon Oct 31 19:26:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-916769467 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 19:26:26.810200 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-37b5e8bc-125f-4189-82ca-2f7d4d943cc2 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:26:26.810861 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-37b5e8bc-125f-4189-82ca-2f7d4d943cc2 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] [instance: fb16e6d4-57d8-4185-9955-ec1d261b365d] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:26:26.820712 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-37b5e8bc-125f-4189-82ca-2f7d4d943cc2 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:26.821217 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-37b5e8bc-125f-4189-82ca-2f7d4d943cc2 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:26.821688 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-37b5e8bc-125f-4189-82ca-2f7d4d943cc2 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:26.822436 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-37b5e8bc-125f-4189-82ca-2f7d4d943cc2 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:26.822899 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-37b5e8bc-125f-4189-82ca-2f7d4d943cc2 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:26.823331 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-37b5e8bc-125f-4189-82ca-2f7d4d943cc2 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:27.176527 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-37b5e8bc-125f-4189-82ca-2f7d4d943cc2 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5cfee7994ab404d974d86d77e075209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33bb29688304d0dae3cfdc0eb54b7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:27.185380 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-37b5e8bc-125f-4189-82ca-2f7d4d943cc2 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] 10.222.0.16 "GET /compute/v2.1/servers/fb16e6d4-57d8-4185-9955-ec1d261b365d" status: 200 len: 1568 microversion: 2.1 time: 0.379687 Oct 31 19:26:27.185974 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 377/752] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:26:26 2022] GET /compute/v2.1/servers/fb16e6d4-57d8-4185-9955-ec1d261b365d => generated 1568 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:26:27.526452 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-3257a071-11e6-486c-87d6-efab23372b18 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:26:27.527666 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-3257a071-11e6-486c-87d6-efab23372b18 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] [instance: 7a47cd33-e4a0-4b78-9afc-2f371e4a9d10] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:26:27.535336 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-3257a071-11e6-486c-87d6-efab23372b18 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:27.535882 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-3257a071-11e6-486c-87d6-efab23372b18 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:27.536317 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-3257a071-11e6-486c-87d6-efab23372b18 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:27.537025 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-3257a071-11e6-486c-87d6-efab23372b18 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:27.537853 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-3257a071-11e6-486c-87d6-efab23372b18 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:27.538471 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-3257a071-11e6-486c-87d6-efab23372b18 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:27.568939 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.wsgi [None req-3257a071-11e6-486c-87d6-efab23372b18 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] HTTP exception thrown: Instance 7a47cd33-e4a0-4b78-9afc-2f371e4a9d10 could not be found. Oct 31 19:26:27.570907 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-3257a071-11e6-486c-87d6-efab23372b18 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Request method failure captured: Oct 31 19:26:27.570907 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: request: GET /compute/v2.1/servers/7a47cd33-e4a0-4b78-9afc-2f371e4a9d10 HTTP/1.1 Oct 31 19:26:27.570907 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Accept: application/json Oct 31 19:26:27.570907 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Accept-Encoding: identity Oct 31 19:26:27.570907 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Connection: close Oct 31 19:26:27.570907 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Content-Length: 0 Oct 31 19:26:27.570907 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Content-Type: application/json Oct 31 19:26:27.570907 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Host: 10.222.0.16 Oct 31 19:26:27.570907 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Openstack-System-Scope: None Oct 31 19:26:27.570907 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: User-Agent: python-urllib3/1.26.12 Oct 31 19:26:27.570907 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Auth-Token: gAAAAABjYCAUQ8YIOE1LqUgdd-VNJVSMmtJLqLbK8GSGQuylkQibi1W0G15Xlmc42Ab2ILvZHAFaOwUXTuxHL77kGeaOPHnfv7wa7hvLMGAh1mz7JFprCgygCLONv8fHZR7cWDh7VdBpvVSZYSPSFRHB1FTdSs8ZWKVZbGgsG6vqf9BFw1oXMP8 Oct 31 19:26:27.570907 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Domain-Id: None Oct 31 19:26:27.570907 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Domain-Name: None Oct 31 19:26:27.570907 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Identity-Status: Confirmed Oct 31 19:26:27.570907 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Is-Admin-Project: True Oct 31 19:26:27.570907 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Project-Domain-Id: default Oct 31 19:26:27.570907 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Project-Domain-Name: Default Oct 31 19:26:27.570907 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Project-Id: 73cf63c76fc543428404002ae9a75b29 Oct 31 19:26:27.570907 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-466281787 Oct 31 19:26:27.570907 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Role: member,reader Oct 31 19:26:27.570907 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Roles: member,reader Oct 31 19:26:27.572550 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/73cf63c76fc543428404002ae9a75b29"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_73cf63c76fc543428404002ae9a75b29", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/73cf63c76fc543428404002ae9a75b29"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/73cf63c76fc543428404002ae9a75b29"}]}] Oct 31 19:26:27.572550 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Tenant: tempest-ServerRescueNegativeTestJSON-466281787 Oct 31 19:26:27.572550 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Tenant-Id: 73cf63c76fc543428404002ae9a75b29 Oct 31 19:26:27.572550 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-466281787 Oct 31 19:26:27.572550 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User: tempest-ServerRescueNegativeTestJSON-466281787-project Oct 31 19:26:27.572550 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User-Domain-Id: default Oct 31 19:26:27.572550 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User-Domain-Name: Default Oct 31 19:26:27.572550 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User-Id: ddc49f9eb3114759b2889ed8972136d8 Oct 31 19:26:27.572550 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User-Name: tempest-ServerRescueNegativeTestJSON-466281787-project Oct 31 19:26:27.572550 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: method: > Oct 31 19:26:27.572550 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: exception: Instance 7a47cd33-e4a0-4b78-9afc-2f371e4a9d10 could not be found. Oct 31 19:26:27.572550 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: action_args: {'id': '7a47cd33-e4a0-4b78-9afc-2f371e4a9d10'} Oct 31 19:26:27.573431 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 19:26:27.573431 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:26:27.573431 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 19:26:27.573431 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 19:26:27.573431 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 19:26:27.573431 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 19:26:27.573431 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 19:26:27.573431 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 19:26:27.573431 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 19:26:27.573431 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 19:26:27.573431 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a47cd33-e4a0-4b78-9afc-2f371e4a9d10 could not be found. Oct 31 19:26:27.573431 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:26:27.573431 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 19:26:27.573431 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:26:27.573431 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:26:27.573431 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 19:26:27.573431 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 19:26:27.573431 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 19:26:27.573431 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 19:26:27.573431 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 19:26:27.574936 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 19:26:27.574936 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 19:26:27.574936 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 19:26:27.574936 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 19:26:27.574936 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 19:26:27.574936 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 19:26:27.574936 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 19:26:27.574936 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a47cd33-e4a0-4b78-9afc-2f371e4a9d10 could not be found. Oct 31 19:26:27.574936 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:26:27.574936 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 19:26:27.574936 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:26:27.574936 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:26:27.574936 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 19:26:27.574936 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 19:26:27.574936 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 19:26:27.574936 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 19:26:27.574936 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a47cd33-e4a0-4b78-9afc-2f371e4a9d10 could not be found. Oct 31 19:26:27.574936 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:26:27.577827 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-3257a071-11e6-486c-87d6-efab23372b18 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] Returning 404 to user: Instance 7a47cd33-e4a0-4b78-9afc-2f371e4a9d10 could not be found. {{(pid=118727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 19:26:27.578868 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-3257a071-11e6-486c-87d6-efab23372b18 tempest-ServerRescueNegativeTestJSON-466281787 tempest-ServerRescueNegativeTestJSON-466281787-project] 10.222.0.16 "GET /compute/v2.1/servers/7a47cd33-e4a0-4b78-9afc-2f371e4a9d10" status: 404 len: 111 microversion: 2.1 time: 0.061942 Oct 31 19:26:27.579841 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 376/753] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:26:27 2022] GET /compute/v2.1/servers/7a47cd33-e4a0-4b78-9afc-2f371e4a9d10 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 19:26:28.209769 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-13409e9a-7323-4397-bfc9-c2deac11e8df tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:26:28.210687 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-13409e9a-7323-4397-bfc9-c2deac11e8df tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] [instance: fb16e6d4-57d8-4185-9955-ec1d261b365d] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:26:28.218248 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-13409e9a-7323-4397-bfc9-c2deac11e8df tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:28.218731 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-13409e9a-7323-4397-bfc9-c2deac11e8df tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:28.219252 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-13409e9a-7323-4397-bfc9-c2deac11e8df tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:28.220015 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-13409e9a-7323-4397-bfc9-c2deac11e8df tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:28.220552 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-13409e9a-7323-4397-bfc9-c2deac11e8df tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:28.221154 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-13409e9a-7323-4397-bfc9-c2deac11e8df tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:28.534425 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-13409e9a-7323-4397-bfc9-c2deac11e8df tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5cfee7994ab404d974d86d77e075209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33bb29688304d0dae3cfdc0eb54b7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:28.542383 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-13409e9a-7323-4397-bfc9-c2deac11e8df tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] 10.222.0.16 "GET /compute/v2.1/servers/fb16e6d4-57d8-4185-9955-ec1d261b365d" status: 200 len: 1509 microversion: 2.1 time: 0.337007 Oct 31 19:26:28.542946 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 378/754] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:26:28 2022] GET /compute/v2.1/servers/fb16e6d4-57d8-4185-9955-ec1d261b365d => generated 1509 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:26:28.564682 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-b04e3471-1ab5-47b4-aa88-814f1e6316f8 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:26:28.565270 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-b04e3471-1ab5-47b4-aa88-814f1e6316f8 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] [instance: fb16e6d4-57d8-4185-9955-ec1d261b365d] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:26:28.572380 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-b04e3471-1ab5-47b4-aa88-814f1e6316f8 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:28.572858 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-b04e3471-1ab5-47b4-aa88-814f1e6316f8 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:28.573285 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-b04e3471-1ab5-47b4-aa88-814f1e6316f8 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:28.573994 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-b04e3471-1ab5-47b4-aa88-814f1e6316f8 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:28.574442 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-b04e3471-1ab5-47b4-aa88-814f1e6316f8 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:28.574857 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-b04e3471-1ab5-47b4-aa88-814f1e6316f8 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:28.618469 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-b04e3471-1ab5-47b4-aa88-814f1e6316f8 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] [instance: fb16e6d4-57d8-4185-9955-ec1d261b365d] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=118727) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 31 19:26:28.630810 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG dbcounter [-] [118727] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=118727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:26:28.689440 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-b04e3471-1ab5-47b4-aa88-814f1e6316f8 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] 10.222.0.16 "POST /compute/v2.1/servers/fb16e6d4-57d8-4185-9955-ec1d261b365d/action" status: 202 len: 0 microversion: 2.1 time: 0.128478 Oct 31 19:26:28.690689 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 377/755] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 31 19:26:28 2022] POST /compute/v2.1/servers/fb16e6d4-57d8-4185-9955-ec1d261b365d/action => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 19:26:28.702353 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-788c4cbd-03a9-4e5f-b9a2-04c625898f87 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:26:28.702978 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-788c4cbd-03a9-4e5f-b9a2-04c625898f87 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] [instance: fb16e6d4-57d8-4185-9955-ec1d261b365d] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:26:28.709065 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-788c4cbd-03a9-4e5f-b9a2-04c625898f87 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:28.709564 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-788c4cbd-03a9-4e5f-b9a2-04c625898f87 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:28.710076 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-788c4cbd-03a9-4e5f-b9a2-04c625898f87 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:28.710843 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-788c4cbd-03a9-4e5f-b9a2-04c625898f87 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:28.711303 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-788c4cbd-03a9-4e5f-b9a2-04c625898f87 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:28.711917 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-788c4cbd-03a9-4e5f-b9a2-04c625898f87 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:29.035856 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-788c4cbd-03a9-4e5f-b9a2-04c625898f87 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5cfee7994ab404d974d86d77e075209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33bb29688304d0dae3cfdc0eb54b7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:29.045652 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-788c4cbd-03a9-4e5f-b9a2-04c625898f87 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] 10.222.0.16 "GET /compute/v2.1/servers/fb16e6d4-57d8-4185-9955-ec1d261b365d" status: 200 len: 1517 microversion: 2.1 time: 0.348235 Oct 31 19:26:29.058385 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 379/756] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:26:28 2022] GET /compute/v2.1/servers/fb16e6d4-57d8-4185-9955-ec1d261b365d => generated 1517 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 19:26:29.189082 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-d55dedd6-069c-4c14-9a36-94c97096110f tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:26:29.190069 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-d55dedd6-069c-4c14-9a36-94c97096110f tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:26:29.201804 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-d55dedd6-069c-4c14-9a36-94c97096110f tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:29.202480 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-d55dedd6-069c-4c14-9a36-94c97096110f tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:29.203099 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-d55dedd6-069c-4c14-9a36-94c97096110f tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:29.203959 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-d55dedd6-069c-4c14-9a36-94c97096110f tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:29.204569 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-d55dedd6-069c-4c14-9a36-94c97096110f tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:29.205148 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-d55dedd6-069c-4c14-9a36-94c97096110f tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:29.236168 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-d55dedd6-069c-4c14-9a36-94c97096110f tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29/ips" status: 200 len: 152 microversion: 2.20 time: 0.055212 Oct 31 19:26:29.238004 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 378/757] 10.222.0.16 () {60 vars in 1289 bytes} [Mon Oct 31 19:26:29 2022] GET /compute/v2.1/servers/3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29/ips => generated 152 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 19:26:30.069881 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-c848c321-c1f1-4429-8461-187fb6e5270e tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:26:30.071423 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-c848c321-c1f1-4429-8461-187fb6e5270e tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] [instance: fb16e6d4-57d8-4185-9955-ec1d261b365d] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:26:30.079075 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-c848c321-c1f1-4429-8461-187fb6e5270e tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:30.079972 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-c848c321-c1f1-4429-8461-187fb6e5270e tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:30.080778 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-c848c321-c1f1-4429-8461-187fb6e5270e tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:30.082052 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-c848c321-c1f1-4429-8461-187fb6e5270e tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:30.082977 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-c848c321-c1f1-4429-8461-187fb6e5270e tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:30.083634 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-c848c321-c1f1-4429-8461-187fb6e5270e tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:30.862694 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [req-8cdb9f5f-c9b3-4ddd-9215-a3315d456bff req-91502eaa-3bc1-4cb8-926c-fc7145625af9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb16e6d4-57d8-4185-9955-ec1d261b365d", "name": "network-vif-unplugged", "status": "completed", "tag": "d4d5c6c7-d643-4ff8-859d-8b480d999f74"}]} {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:26:30.881660 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [req-8cdb9f5f-c9b3-4ddd-9215-a3315d456bff req-91502eaa-3bc1-4cb8-926c-fc7145625af9 service nova] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:30.882168 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [req-8cdb9f5f-c9b3-4ddd-9215-a3315d456bff req-91502eaa-3bc1-4cb8-926c-fc7145625af9 service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:30.882603 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [req-8cdb9f5f-c9b3-4ddd-9215-a3315d456bff req-91502eaa-3bc1-4cb8-926c-fc7145625af9 service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:30.912959 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.compute.server_external_events [req-8cdb9f5f-c9b3-4ddd-9215-a3315d456bff req-91502eaa-3bc1-4cb8-926c-fc7145625af9 service nova] Creating event network-vif-unplugged:d4d5c6c7-d643-4ff8-859d-8b480d999f74 for instance fb16e6d4-57d8-4185-9955-ec1d261b365d on hv-cinder-86309 Oct 31 19:26:30.920277 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [req-8cdb9f5f-c9b3-4ddd-9215-a3315d456bff req-91502eaa-3bc1-4cb8-926c-fc7145625af9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.272543 Oct 31 19:26:30.921560 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 379/758] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 31 19:26:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 19:26:30.999777 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-c848c321-c1f1-4429-8461-187fb6e5270e tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5cfee7994ab404d974d86d77e075209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33bb29688304d0dae3cfdc0eb54b7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:31.010623 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-c848c321-c1f1-4429-8461-187fb6e5270e tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] 10.222.0.16 "GET /compute/v2.1/servers/fb16e6d4-57d8-4185-9955-ec1d261b365d" status: 200 len: 1519 microversion: 2.1 time: 0.944576 Oct 31 19:26:31.011975 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 380/759] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:26:30 2022] GET /compute/v2.1/servers/fb16e6d4-57d8-4185-9955-ec1d261b365d => generated 1519 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:26:31.439153 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-7c8b88b0-885d-4585-b527-30c416eece1a tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:26:31.439784 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-7c8b88b0-885d-4585-b527-30c416eece1a tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:26:31.459556 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-7c8b88b0-885d-4585-b527-30c416eece1a tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:31.460859 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-7c8b88b0-885d-4585-b527-30c416eece1a tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:31.460859 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-7c8b88b0-885d-4585-b527-30c416eece1a tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:31.461229 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-7c8b88b0-885d-4585-b527-30c416eece1a tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:31.461883 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-7c8b88b0-885d-4585-b527-30c416eece1a tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:31.462204 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-7c8b88b0-885d-4585-b527-30c416eece1a tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:31.508690 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.objects.instance [None req-7c8b88b0-885d-4585-b527-30c416eece1a tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lazy-loading 'flavor' on Instance uuid 3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29 {{(pid=118727) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 19:26:31.884979 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-7c8b88b0-885d-4585-b527-30c416eece1a tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "POST /compute/v2.1/servers/3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29/action" status: 202 len: 0 microversion: 2.20 time: 0.449551 Oct 31 19:26:31.895348 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-fe3db705-ed81-43bd-9379-50b0fb08e7a9 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:26:31.896886 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-fe3db705-ed81-43bd-9379-50b0fb08e7a9 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:26:31.901570 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 380/760] 10.222.0.16 () {62 vars in 1319 bytes} [Mon Oct 31 19:26:31 2022] POST /compute/v2.1/servers/3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29/action => generated 0 bytes in 468 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 31 19:26:31.905924 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-fe3db705-ed81-43bd-9379-50b0fb08e7a9 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:31.906751 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-fe3db705-ed81-43bd-9379-50b0fb08e7a9 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:31.907387 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-fe3db705-ed81-43bd-9379-50b0fb08e7a9 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:31.908294 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-fe3db705-ed81-43bd-9379-50b0fb08e7a9 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:31.910433 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-fe3db705-ed81-43bd-9379-50b0fb08e7a9 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:31.911097 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-fe3db705-ed81-43bd-9379-50b0fb08e7a9 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:32.037567 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-1299f86e-481d-43b2-ab2e-3efdd351bd80 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:26:32.040396 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-1299f86e-481d-43b2-ab2e-3efdd351bd80 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] [instance: fb16e6d4-57d8-4185-9955-ec1d261b365d] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:26:32.083820 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-1299f86e-481d-43b2-ab2e-3efdd351bd80 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:32.086466 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-1299f86e-481d-43b2-ab2e-3efdd351bd80 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:32.087138 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-1299f86e-481d-43b2-ab2e-3efdd351bd80 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:32.089188 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-1299f86e-481d-43b2-ab2e-3efdd351bd80 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:32.098863 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-1299f86e-481d-43b2-ab2e-3efdd351bd80 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:32.099193 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-1299f86e-481d-43b2-ab2e-3efdd351bd80 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:32.132846 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG dbcounter [-] [118727] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:26:32.270418 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-fe3db705-ed81-43bd-9379-50b0fb08e7a9 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:32.282724 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-fe3db705-ed81-43bd-9379-50b0fb08e7a9 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:32.284489 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-fe3db705-ed81-43bd-9379-50b0fb08e7a9 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:32.287814 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-fe3db705-ed81-43bd-9379-50b0fb08e7a9 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29" status: 200 len: 1725 microversion: 2.20 time: 0.396926 Oct 31 19:26:32.288862 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 381/761] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 31 19:26:31 2022] GET /compute/v2.1/servers/3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29 => generated 1725 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 19:26:32.394403 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-1299f86e-481d-43b2-ab2e-3efdd351bd80 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5cfee7994ab404d974d86d77e075209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33bb29688304d0dae3cfdc0eb54b7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:32.419132 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-1299f86e-481d-43b2-ab2e-3efdd351bd80 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] 10.222.0.16 "GET /compute/v2.1/servers/fb16e6d4-57d8-4185-9955-ec1d261b365d" status: 200 len: 1575 microversion: 2.1 time: 0.387948 Oct 31 19:26:32.421916 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 381/762] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:26:32 2022] GET /compute/v2.1/servers/fb16e6d4-57d8-4185-9955-ec1d261b365d => generated 1575 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:26:33.318851 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-6e4db733-8d43-413c-9797-2758b06e6887 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:26:33.320009 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-6e4db733-8d43-413c-9797-2758b06e6887 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:26:33.326900 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-6e4db733-8d43-413c-9797-2758b06e6887 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:33.327616 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-6e4db733-8d43-413c-9797-2758b06e6887 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:33.328228 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-6e4db733-8d43-413c-9797-2758b06e6887 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:33.329081 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-6e4db733-8d43-413c-9797-2758b06e6887 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:33.329717 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-6e4db733-8d43-413c-9797-2758b06e6887 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:33.330290 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-6e4db733-8d43-413c-9797-2758b06e6887 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:33.445512 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-f46d7e49-0964-4041-8979-aa0d5e86c3f3 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:26:33.446276 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-f46d7e49-0964-4041-8979-aa0d5e86c3f3 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] [instance: fb16e6d4-57d8-4185-9955-ec1d261b365d] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:26:33.452730 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-f46d7e49-0964-4041-8979-aa0d5e86c3f3 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:33.453503 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-f46d7e49-0964-4041-8979-aa0d5e86c3f3 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:33.454403 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-f46d7e49-0964-4041-8979-aa0d5e86c3f3 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:33.455772 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-f46d7e49-0964-4041-8979-aa0d5e86c3f3 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:33.456311 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-f46d7e49-0964-4041-8979-aa0d5e86c3f3 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:33.456793 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-f46d7e49-0964-4041-8979-aa0d5e86c3f3 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:33.568026 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-6e4db733-8d43-413c-9797-2758b06e6887 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:33.577628 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-6e4db733-8d43-413c-9797-2758b06e6887 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:33.579834 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-6e4db733-8d43-413c-9797-2758b06e6887 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:33.581307 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-6e4db733-8d43-413c-9797-2758b06e6887 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29" status: 200 len: 1725 microversion: 2.20 time: 0.266543 Oct 31 19:26:33.582986 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 382/763] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 31 19:26:33 2022] GET /compute/v2.1/servers/3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29 => generated 1725 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 19:26:33.622902 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-f46d7e49-0964-4041-8979-aa0d5e86c3f3 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5cfee7994ab404d974d86d77e075209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33bb29688304d0dae3cfdc0eb54b7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:33.632917 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-f46d7e49-0964-4041-8979-aa0d5e86c3f3 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] 10.222.0.16 "GET /compute/v2.1/servers/fb16e6d4-57d8-4185-9955-ec1d261b365d" status: 200 len: 1575 microversion: 2.1 time: 0.191227 Oct 31 19:26:33.633493 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 382/764] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:26:33 2022] GET /compute/v2.1/servers/fb16e6d4-57d8-4185-9955-ec1d261b365d => generated 1575 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:26:34.608378 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-7a0bd36b-4863-4636-8571-9691dcf9cfdc tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:26:34.609130 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-7a0bd36b-4863-4636-8571-9691dcf9cfdc tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:26:34.617142 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-7a0bd36b-4863-4636-8571-9691dcf9cfdc tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:34.617904 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-7a0bd36b-4863-4636-8571-9691dcf9cfdc tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:34.618508 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-7a0bd36b-4863-4636-8571-9691dcf9cfdc tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:34.619385 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-7a0bd36b-4863-4636-8571-9691dcf9cfdc tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:34.620210 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-7a0bd36b-4863-4636-8571-9691dcf9cfdc tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:34.620830 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-7a0bd36b-4863-4636-8571-9691dcf9cfdc tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:34.657198 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-e3d3c3fc-10dd-4ef3-999d-773d135779da tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:26:34.657978 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-e3d3c3fc-10dd-4ef3-999d-773d135779da tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] [instance: fb16e6d4-57d8-4185-9955-ec1d261b365d] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:26:34.665160 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-e3d3c3fc-10dd-4ef3-999d-773d135779da tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:34.672650 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-e3d3c3fc-10dd-4ef3-999d-773d135779da tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:34.675682 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-e3d3c3fc-10dd-4ef3-999d-773d135779da tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:34.678407 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-e3d3c3fc-10dd-4ef3-999d-773d135779da tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:34.681044 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-e3d3c3fc-10dd-4ef3-999d-773d135779da tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:34.681491 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-e3d3c3fc-10dd-4ef3-999d-773d135779da tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:34.891404 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-e3d3c3fc-10dd-4ef3-999d-773d135779da tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5cfee7994ab404d974d86d77e075209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33bb29688304d0dae3cfdc0eb54b7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:34.901587 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-e3d3c3fc-10dd-4ef3-999d-773d135779da tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] 10.222.0.16 "GET /compute/v2.1/servers/fb16e6d4-57d8-4185-9955-ec1d261b365d" status: 200 len: 1575 microversion: 2.1 time: 0.248283 Oct 31 19:26:34.903024 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 383/765] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:26:34 2022] GET /compute/v2.1/servers/fb16e6d4-57d8-4185-9955-ec1d261b365d => generated 1575 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:26:35.313577 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-7a0bd36b-4863-4636-8571-9691dcf9cfdc tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:35.328979 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-7a0bd36b-4863-4636-8571-9691dcf9cfdc tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:35.330782 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-7a0bd36b-4863-4636-8571-9691dcf9cfdc tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:35.332329 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-7a0bd36b-4863-4636-8571-9691dcf9cfdc tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29" status: 200 len: 1725 microversion: 2.20 time: 0.727877 Oct 31 19:26:35.346173 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 383/766] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 31 19:26:34 2022] GET /compute/v2.1/servers/3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29 => generated 1725 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 19:26:35.929177 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-fc64ceb6-dfe9-4dd4-a1b6-f3e2790156c5 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:26:35.930420 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-fc64ceb6-dfe9-4dd4-a1b6-f3e2790156c5 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] [instance: fb16e6d4-57d8-4185-9955-ec1d261b365d] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:26:35.937257 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-fc64ceb6-dfe9-4dd4-a1b6-f3e2790156c5 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:35.939036 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-fc64ceb6-dfe9-4dd4-a1b6-f3e2790156c5 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:35.939679 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-fc64ceb6-dfe9-4dd4-a1b6-f3e2790156c5 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:35.940542 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-fc64ceb6-dfe9-4dd4-a1b6-f3e2790156c5 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:35.941867 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-fc64ceb6-dfe9-4dd4-a1b6-f3e2790156c5 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:35.942465 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-fc64ceb6-dfe9-4dd4-a1b6-f3e2790156c5 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:36.108820 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-fc64ceb6-dfe9-4dd4-a1b6-f3e2790156c5 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5cfee7994ab404d974d86d77e075209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33bb29688304d0dae3cfdc0eb54b7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:36.118699 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-fc64ceb6-dfe9-4dd4-a1b6-f3e2790156c5 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] 10.222.0.16 "GET /compute/v2.1/servers/fb16e6d4-57d8-4185-9955-ec1d261b365d" status: 200 len: 1575 microversion: 2.1 time: 0.195207 Oct 31 19:26:36.128452 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 384/767] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:26:35 2022] GET /compute/v2.1/servers/fb16e6d4-57d8-4185-9955-ec1d261b365d => generated 1575 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:26:36.359788 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-261bc5df-6211-41e0-867c-a12c2220ea13 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:26:36.361162 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-261bc5df-6211-41e0-867c-a12c2220ea13 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:26:36.372164 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-261bc5df-6211-41e0-867c-a12c2220ea13 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:36.372963 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-261bc5df-6211-41e0-867c-a12c2220ea13 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:36.373651 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-261bc5df-6211-41e0-867c-a12c2220ea13 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:36.374553 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-261bc5df-6211-41e0-867c-a12c2220ea13 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:36.375199 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-261bc5df-6211-41e0-867c-a12c2220ea13 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:36.375815 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-261bc5df-6211-41e0-867c-a12c2220ea13 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:36.546187 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-261bc5df-6211-41e0-867c-a12c2220ea13 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:36.555541 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-261bc5df-6211-41e0-867c-a12c2220ea13 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:36.557137 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-261bc5df-6211-41e0-867c-a12c2220ea13 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:36.558323 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-261bc5df-6211-41e0-867c-a12c2220ea13 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29" status: 200 len: 1725 microversion: 2.20 time: 0.202578 Oct 31 19:26:36.558941 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 384/768] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 31 19:26:36 2022] GET /compute/v2.1/servers/3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29 => generated 1725 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 19:26:37.147973 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-b3837453-db2e-4518-b056-c02cdff0d88c tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:26:37.148634 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-b3837453-db2e-4518-b056-c02cdff0d88c tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] [instance: fb16e6d4-57d8-4185-9955-ec1d261b365d] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:26:37.155362 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-b3837453-db2e-4518-b056-c02cdff0d88c tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:37.155849 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-b3837453-db2e-4518-b056-c02cdff0d88c tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:37.156284 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-b3837453-db2e-4518-b056-c02cdff0d88c tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:37.157168 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-b3837453-db2e-4518-b056-c02cdff0d88c tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:37.157827 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-b3837453-db2e-4518-b056-c02cdff0d88c tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:37.158411 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-b3837453-db2e-4518-b056-c02cdff0d88c tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:37.347810 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-b3837453-db2e-4518-b056-c02cdff0d88c tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5cfee7994ab404d974d86d77e075209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33bb29688304d0dae3cfdc0eb54b7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:37.359057 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-b3837453-db2e-4518-b056-c02cdff0d88c tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] 10.222.0.16 "GET /compute/v2.1/servers/fb16e6d4-57d8-4185-9955-ec1d261b365d" status: 200 len: 1575 microversion: 2.1 time: 0.216426 Oct 31 19:26:37.359924 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 385/769] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:26:37 2022] GET /compute/v2.1/servers/fb16e6d4-57d8-4185-9955-ec1d261b365d => generated 1575 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:26:37.584315 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-0926e8fd-159e-434b-afba-5adba46b8528 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:26:37.585011 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-0926e8fd-159e-434b-afba-5adba46b8528 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:26:37.594808 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-0926e8fd-159e-434b-afba-5adba46b8528 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:37.594808 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-0926e8fd-159e-434b-afba-5adba46b8528 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:37.594808 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-0926e8fd-159e-434b-afba-5adba46b8528 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:37.594808 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-0926e8fd-159e-434b-afba-5adba46b8528 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:37.595311 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-0926e8fd-159e-434b-afba-5adba46b8528 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:37.595311 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-0926e8fd-159e-434b-afba-5adba46b8528 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:37.745025 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-0926e8fd-159e-434b-afba-5adba46b8528 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:37.756663 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-0926e8fd-159e-434b-afba-5adba46b8528 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:37.758679 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-0926e8fd-159e-434b-afba-5adba46b8528 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:37.761318 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-0926e8fd-159e-434b-afba-5adba46b8528 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29" status: 200 len: 1725 microversion: 2.20 time: 0.180848 Oct 31 19:26:37.762514 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 385/770] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 31 19:26:37 2022] GET /compute/v2.1/servers/3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29 => generated 1725 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 19:26:38.382638 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-01ebee35-1d9c-415a-a974-7a01dd031e90 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:26:38.383251 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-01ebee35-1d9c-415a-a974-7a01dd031e90 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] [instance: fb16e6d4-57d8-4185-9955-ec1d261b365d] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:26:38.389814 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-01ebee35-1d9c-415a-a974-7a01dd031e90 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:38.390298 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-01ebee35-1d9c-415a-a974-7a01dd031e90 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:38.390735 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-01ebee35-1d9c-415a-a974-7a01dd031e90 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:38.391431 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-01ebee35-1d9c-415a-a974-7a01dd031e90 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:38.391885 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-01ebee35-1d9c-415a-a974-7a01dd031e90 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:38.392526 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-01ebee35-1d9c-415a-a974-7a01dd031e90 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:38.533457 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-01ebee35-1d9c-415a-a974-7a01dd031e90 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5cfee7994ab404d974d86d77e075209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33bb29688304d0dae3cfdc0eb54b7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:38.542381 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-01ebee35-1d9c-415a-a974-7a01dd031e90 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] 10.222.0.16 "GET /compute/v2.1/servers/fb16e6d4-57d8-4185-9955-ec1d261b365d" status: 200 len: 1575 microversion: 2.1 time: 0.163736 Oct 31 19:26:38.542956 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 386/771] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:26:38 2022] GET /compute/v2.1/servers/fb16e6d4-57d8-4185-9955-ec1d261b365d => generated 1575 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:26:38.786675 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-1a2dfe9f-1819-46c6-8775-692694d97037 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:26:38.787277 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-1a2dfe9f-1819-46c6-8775-692694d97037 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:26:38.793816 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-1a2dfe9f-1819-46c6-8775-692694d97037 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:38.794292 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-1a2dfe9f-1819-46c6-8775-692694d97037 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:38.794718 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-1a2dfe9f-1819-46c6-8775-692694d97037 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:38.795562 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-1a2dfe9f-1819-46c6-8775-692694d97037 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:38.796021 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-1a2dfe9f-1819-46c6-8775-692694d97037 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:38.796444 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-1a2dfe9f-1819-46c6-8775-692694d97037 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:38.931190 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-1a2dfe9f-1819-46c6-8775-692694d97037 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:38.949073 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-1a2dfe9f-1819-46c6-8775-692694d97037 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:38.950649 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-1a2dfe9f-1819-46c6-8775-692694d97037 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:38.951886 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-1a2dfe9f-1819-46c6-8775-692694d97037 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29" status: 200 len: 1725 microversion: 2.20 time: 0.169017 Oct 31 19:26:38.953640 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 386/772] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 31 19:26:38 2022] GET /compute/v2.1/servers/3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29 => generated 1725 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 19:26:39.565165 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-7169b45e-e84d-4001-894d-eeefc3ae5ef7 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:26:39.565821 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-7169b45e-e84d-4001-894d-eeefc3ae5ef7 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] [instance: fb16e6d4-57d8-4185-9955-ec1d261b365d] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:26:39.572232 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-7169b45e-e84d-4001-894d-eeefc3ae5ef7 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:39.572715 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-7169b45e-e84d-4001-894d-eeefc3ae5ef7 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:39.573148 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-7169b45e-e84d-4001-894d-eeefc3ae5ef7 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:39.573860 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-7169b45e-e84d-4001-894d-eeefc3ae5ef7 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:39.574313 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-7169b45e-e84d-4001-894d-eeefc3ae5ef7 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:39.574734 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-7169b45e-e84d-4001-894d-eeefc3ae5ef7 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:39.709814 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-7169b45e-e84d-4001-894d-eeefc3ae5ef7 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5cfee7994ab404d974d86d77e075209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33bb29688304d0dae3cfdc0eb54b7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:39.717369 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-7169b45e-e84d-4001-894d-eeefc3ae5ef7 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] 10.222.0.16 "GET /compute/v2.1/servers/fb16e6d4-57d8-4185-9955-ec1d261b365d" status: 200 len: 1575 microversion: 2.1 time: 0.156003 Oct 31 19:26:39.718153 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 387/773] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:26:39 2022] GET /compute/v2.1/servers/fb16e6d4-57d8-4185-9955-ec1d261b365d => generated 1575 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:26:39.948288 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-d171c2ab-ef4d-48e4-9a00-2ce1b761482e tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:26:39.948883 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-d171c2ab-ef4d-48e4-9a00-2ce1b761482e tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] [instance: 31bf9c76-adbe-4c58-8d9e-f332e36f86db] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:26:39.955459 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-d171c2ab-ef4d-48e4-9a00-2ce1b761482e tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:39.955956 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-d171c2ab-ef4d-48e4-9a00-2ce1b761482e tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:39.956401 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-d171c2ab-ef4d-48e4-9a00-2ce1b761482e tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:39.957662 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-d171c2ab-ef4d-48e4-9a00-2ce1b761482e tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:39.958130 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-d171c2ab-ef4d-48e4-9a00-2ce1b761482e tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:39.958561 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-d171c2ab-ef4d-48e4-9a00-2ce1b761482e tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:39.981016 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-1d63264f-baf6-4e0d-be1f-aee1fdf5f672 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:26:39.981840 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-1d63264f-baf6-4e0d-be1f-aee1fdf5f672 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:26:39.988354 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-1d63264f-baf6-4e0d-be1f-aee1fdf5f672 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:39.988976 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-1d63264f-baf6-4e0d-be1f-aee1fdf5f672 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:39.989482 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-1d63264f-baf6-4e0d-be1f-aee1fdf5f672 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:39.990282 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-1d63264f-baf6-4e0d-be1f-aee1fdf5f672 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:39.990879 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-1d63264f-baf6-4e0d-be1f-aee1fdf5f672 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:39.991320 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-1d63264f-baf6-4e0d-be1f-aee1fdf5f672 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:40.002524 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-d171c2ab-ef4d-48e4-9a00-2ce1b761482e tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] [instance: 31bf9c76-adbe-4c58-8d9e-f332e36f86db] Going to try to terminate instance {{(pid=118726) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 19:26:40.089476 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-d171c2ab-ef4d-48e4-9a00-2ce1b761482e tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] 10.222.0.16 "DELETE /compute/v2.1/servers/31bf9c76-adbe-4c58-8d9e-f332e36f86db" status: 204 len: 0 microversion: 2.1 time: 0.144645 Oct 31 19:26:40.090259 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 387/774] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 31 19:26:39 2022] DELETE /compute/v2.1/servers/31bf9c76-adbe-4c58-8d9e-f332e36f86db => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 19:26:40.101134 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-57b6e347-3c3d-4276-a66f-b04a70c50b98 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:26:40.102019 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-57b6e347-3c3d-4276-a66f-b04a70c50b98 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] [instance: 31bf9c76-adbe-4c58-8d9e-f332e36f86db] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:26:40.108421 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-57b6e347-3c3d-4276-a66f-b04a70c50b98 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:40.108964 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-57b6e347-3c3d-4276-a66f-b04a70c50b98 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:40.109406 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-57b6e347-3c3d-4276-a66f-b04a70c50b98 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:40.110143 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-57b6e347-3c3d-4276-a66f-b04a70c50b98 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:40.110623 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-57b6e347-3c3d-4276-a66f-b04a70c50b98 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:40.111038 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-57b6e347-3c3d-4276-a66f-b04a70c50b98 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:40.157438 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-1d63264f-baf6-4e0d-be1f-aee1fdf5f672 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:40.166463 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-1d63264f-baf6-4e0d-be1f-aee1fdf5f672 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:40.167893 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-1d63264f-baf6-4e0d-be1f-aee1fdf5f672 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:40.169032 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-1d63264f-baf6-4e0d-be1f-aee1fdf5f672 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29" status: 200 len: 1725 microversion: 2.20 time: 0.192657 Oct 31 19:26:40.169587 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 388/775] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 31 19:26:39 2022] GET /compute/v2.1/servers/3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29 => generated 1725 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 19:26:40.242497 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-57b6e347-3c3d-4276-a66f-b04a70c50b98 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e73a60801b04fc7acc4260297fdd2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808cc3e5392b4bb7a80b154a60f69ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:40.251048 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-57b6e347-3c3d-4276-a66f-b04a70c50b98 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] 10.222.0.16 "GET /compute/v2.1/servers/31bf9c76-adbe-4c58-8d9e-f332e36f86db" status: 200 len: 1576 microversion: 2.1 time: 0.155859 Oct 31 19:26:40.251611 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 388/776] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:26:40 2022] GET /compute/v2.1/servers/31bf9c76-adbe-4c58-8d9e-f332e36f86db => generated 1576 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 19:26:40.740826 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-fec3c915-2cd0-4b18-929f-ebac6d4ae4a2 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:26:40.741412 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-fec3c915-2cd0-4b18-929f-ebac6d4ae4a2 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] [instance: fb16e6d4-57d8-4185-9955-ec1d261b365d] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:26:40.747764 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-fec3c915-2cd0-4b18-929f-ebac6d4ae4a2 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:40.748246 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-fec3c915-2cd0-4b18-929f-ebac6d4ae4a2 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:40.748679 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-fec3c915-2cd0-4b18-929f-ebac6d4ae4a2 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:40.749373 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-fec3c915-2cd0-4b18-929f-ebac6d4ae4a2 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:40.749854 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-fec3c915-2cd0-4b18-929f-ebac6d4ae4a2 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:40.750277 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-fec3c915-2cd0-4b18-929f-ebac6d4ae4a2 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:40.884496 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-fec3c915-2cd0-4b18-929f-ebac6d4ae4a2 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5cfee7994ab404d974d86d77e075209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33bb29688304d0dae3cfdc0eb54b7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:40.892062 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-fec3c915-2cd0-4b18-929f-ebac6d4ae4a2 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] 10.222.0.16 "GET /compute/v2.1/servers/fb16e6d4-57d8-4185-9955-ec1d261b365d" status: 200 len: 1575 microversion: 2.1 time: 0.155729 Oct 31 19:26:40.892628 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 389/777] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:26:40 2022] GET /compute/v2.1/servers/fb16e6d4-57d8-4185-9955-ec1d261b365d => generated 1575 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:26:41.194839 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-1e0aada7-7384-4c1f-b576-ae1872f45441 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:26:41.195462 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-1e0aada7-7384-4c1f-b576-ae1872f45441 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:26:41.202004 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-1e0aada7-7384-4c1f-b576-ae1872f45441 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:41.202493 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-1e0aada7-7384-4c1f-b576-ae1872f45441 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:41.203101 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-1e0aada7-7384-4c1f-b576-ae1872f45441 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:41.203682 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-1e0aada7-7384-4c1f-b576-ae1872f45441 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:41.204202 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-1e0aada7-7384-4c1f-b576-ae1872f45441 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:41.204578 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-1e0aada7-7384-4c1f-b576-ae1872f45441 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:41.278161 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-2d57bc1d-d331-41cf-9482-a0b7cb31b543 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:26:41.279036 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-2d57bc1d-d331-41cf-9482-a0b7cb31b543 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] [instance: 31bf9c76-adbe-4c58-8d9e-f332e36f86db] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:26:41.285514 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-2d57bc1d-d331-41cf-9482-a0b7cb31b543 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:41.286028 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-2d57bc1d-d331-41cf-9482-a0b7cb31b543 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:41.286454 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-2d57bc1d-d331-41cf-9482-a0b7cb31b543 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:41.287137 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-2d57bc1d-d331-41cf-9482-a0b7cb31b543 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:41.287585 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-2d57bc1d-d331-41cf-9482-a0b7cb31b543 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:41.287999 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-2d57bc1d-d331-41cf-9482-a0b7cb31b543 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:41.340890 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-1e0aada7-7384-4c1f-b576-ae1872f45441 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:41.349582 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-1e0aada7-7384-4c1f-b576-ae1872f45441 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:41.351025 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-1e0aada7-7384-4c1f-b576-ae1872f45441 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:41.352169 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-1e0aada7-7384-4c1f-b576-ae1872f45441 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29" status: 200 len: 1725 microversion: 2.20 time: 0.161509 Oct 31 19:26:41.352767 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 389/778] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 31 19:26:41 2022] GET /compute/v2.1/servers/3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29 => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 19:26:41.419805 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-2d57bc1d-d331-41cf-9482-a0b7cb31b543 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e73a60801b04fc7acc4260297fdd2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808cc3e5392b4bb7a80b154a60f69ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:41.427977 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-2d57bc1d-d331-41cf-9482-a0b7cb31b543 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] 10.222.0.16 "GET /compute/v2.1/servers/31bf9c76-adbe-4c58-8d9e-f332e36f86db" status: 200 len: 1576 microversion: 2.1 time: 0.154633 Oct 31 19:26:41.428558 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 390/779] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:26:41 2022] GET /compute/v2.1/servers/31bf9c76-adbe-4c58-8d9e-f332e36f86db => generated 1576 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 19:26:41.914202 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-bcab0418-adcd-4792-a398-62639347fa1c tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:26:41.914907 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-bcab0418-adcd-4792-a398-62639347fa1c tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] [instance: fb16e6d4-57d8-4185-9955-ec1d261b365d] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:26:41.921158 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-bcab0418-adcd-4792-a398-62639347fa1c tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:41.921746 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-bcab0418-adcd-4792-a398-62639347fa1c tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:41.922180 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-bcab0418-adcd-4792-a398-62639347fa1c tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:41.922868 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-bcab0418-adcd-4792-a398-62639347fa1c tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:41.923329 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-bcab0418-adcd-4792-a398-62639347fa1c tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:41.923751 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-bcab0418-adcd-4792-a398-62639347fa1c tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:42.053141 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-bcab0418-adcd-4792-a398-62639347fa1c tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5cfee7994ab404d974d86d77e075209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33bb29688304d0dae3cfdc0eb54b7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:42.060877 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-bcab0418-adcd-4792-a398-62639347fa1c tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] 10.222.0.16 "GET /compute/v2.1/servers/fb16e6d4-57d8-4185-9955-ec1d261b365d" status: 200 len: 1575 microversion: 2.1 time: 0.150495 Oct 31 19:26:42.061438 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 390/780] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:26:41 2022] GET /compute/v2.1/servers/fb16e6d4-57d8-4185-9955-ec1d261b365d => generated 1575 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:26:42.377914 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-cbaa960c-d4a0-4e8b-9d99-4839cf89ce6f tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:26:42.378534 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-cbaa960c-d4a0-4e8b-9d99-4839cf89ce6f tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:26:42.385891 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-cbaa960c-d4a0-4e8b-9d99-4839cf89ce6f tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:42.386386 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-cbaa960c-d4a0-4e8b-9d99-4839cf89ce6f tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:42.386816 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-cbaa960c-d4a0-4e8b-9d99-4839cf89ce6f tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:42.387513 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-cbaa960c-d4a0-4e8b-9d99-4839cf89ce6f tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:42.388157 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-cbaa960c-d4a0-4e8b-9d99-4839cf89ce6f tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:42.388580 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-cbaa960c-d4a0-4e8b-9d99-4839cf89ce6f tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:42.452183 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-78bbf492-6bfa-4c70-bed1-a612a85006fa tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:26:42.453383 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-78bbf492-6bfa-4c70-bed1-a612a85006fa tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] [instance: 31bf9c76-adbe-4c58-8d9e-f332e36f86db] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:26:42.458252 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG dbcounter [-] [118726] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=118726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:26:42.462418 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-78bbf492-6bfa-4c70-bed1-a612a85006fa tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:42.462418 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-78bbf492-6bfa-4c70-bed1-a612a85006fa tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:42.462769 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-78bbf492-6bfa-4c70-bed1-a612a85006fa tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:42.463470 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-78bbf492-6bfa-4c70-bed1-a612a85006fa tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:42.463922 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-78bbf492-6bfa-4c70-bed1-a612a85006fa tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:42.464338 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-78bbf492-6bfa-4c70-bed1-a612a85006fa tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:42.494727 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG dbcounter [-] [118726] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:26:42.556445 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-78bbf492-6bfa-4c70-bed1-a612a85006fa tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e73a60801b04fc7acc4260297fdd2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808cc3e5392b4bb7a80b154a60f69ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:42.564740 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-78bbf492-6bfa-4c70-bed1-a612a85006fa tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] 10.222.0.16 "GET /compute/v2.1/servers/31bf9c76-adbe-4c58-8d9e-f332e36f86db" status: 200 len: 1509 microversion: 2.1 time: 0.116877 Oct 31 19:26:42.581487 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 391/781] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:26:42 2022] GET /compute/v2.1/servers/31bf9c76-adbe-4c58-8d9e-f332e36f86db => generated 1509 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:26:42.611960 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [req-16020fbf-7dd0-4106-ac47-4eeb871a55a9 req-93392954-cdd5-45ae-b01b-5de9572e2860 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31bf9c76-adbe-4c58-8d9e-f332e36f86db", "name": "network-vif-deleted", "tag": "1bff50b4-bfa9-4d6c-bcae-38aef9bf842c"}]} {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:26:42.631919 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [req-16020fbf-7dd0-4106-ac47-4eeb871a55a9 req-93392954-cdd5-45ae-b01b-5de9572e2860 service nova] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:42.632263 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [req-16020fbf-7dd0-4106-ac47-4eeb871a55a9 req-93392954-cdd5-45ae-b01b-5de9572e2860 service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:42.632679 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [req-16020fbf-7dd0-4106-ac47-4eeb871a55a9 req-93392954-cdd5-45ae-b01b-5de9572e2860 service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:42.650436 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.compute.server_external_events [req-16020fbf-7dd0-4106-ac47-4eeb871a55a9 req-93392954-cdd5-45ae-b01b-5de9572e2860 service nova] Creating event network-vif-deleted:1bff50b4-bfa9-4d6c-bcae-38aef9bf842c for instance 31bf9c76-adbe-4c58-8d9e-f332e36f86db on hv-cinder-86309 Oct 31 19:26:42.656281 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [req-16020fbf-7dd0-4106-ac47-4eeb871a55a9 req-93392954-cdd5-45ae-b01b-5de9572e2860 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047924 Oct 31 19:26:42.657161 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 392/782] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 31 19:26:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:26:42.658203 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-cbaa960c-d4a0-4e8b-9d99-4839cf89ce6f tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:42.674800 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-cbaa960c-d4a0-4e8b-9d99-4839cf89ce6f tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:42.683074 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-cbaa960c-d4a0-4e8b-9d99-4839cf89ce6f tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:42.686480 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-cbaa960c-d4a0-4e8b-9d99-4839cf89ce6f tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29" status: 200 len: 1725 microversion: 2.20 time: 0.310320 Oct 31 19:26:42.688561 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 391/783] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 31 19:26:42 2022] GET /compute/v2.1/servers/3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29 => generated 1725 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 19:26:42.837920 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [req-9b3f8c6f-ed4e-444f-adb5-c7541cb41605 req-b89c665d-10c9-4de6-8e6e-31033cfaacd8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb16e6d4-57d8-4185-9955-ec1d261b365d", "name": "network-vif-plugged", "status": "completed", "tag": "d4d5c6c7-d643-4ff8-859d-8b480d999f74"}]} {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:26:42.849183 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [req-9b3f8c6f-ed4e-444f-adb5-c7541cb41605 req-b89c665d-10c9-4de6-8e6e-31033cfaacd8 service nova] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:42.850018 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [req-9b3f8c6f-ed4e-444f-adb5-c7541cb41605 req-b89c665d-10c9-4de6-8e6e-31033cfaacd8 service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:42.850525 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [req-9b3f8c6f-ed4e-444f-adb5-c7541cb41605 req-b89c665d-10c9-4de6-8e6e-31033cfaacd8 service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:42.862546 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.compute.server_external_events [req-9b3f8c6f-ed4e-444f-adb5-c7541cb41605 req-b89c665d-10c9-4de6-8e6e-31033cfaacd8 service nova] Creating event network-vif-plugged:d4d5c6c7-d643-4ff8-859d-8b480d999f74 for instance fb16e6d4-57d8-4185-9955-ec1d261b365d on hv-cinder-86309 Oct 31 19:26:42.869322 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [req-9b3f8c6f-ed4e-444f-adb5-c7541cb41605 req-b89c665d-10c9-4de6-8e6e-31033cfaacd8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039950 Oct 31 19:26:42.870693 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 393/784] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 31 19:26:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:26:43.085191 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-a42103c5-56a2-4d6e-b09a-f63f31999df0 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:26:43.085960 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-a42103c5-56a2-4d6e-b09a-f63f31999df0 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] [instance: fb16e6d4-57d8-4185-9955-ec1d261b365d] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:26:43.096453 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-a42103c5-56a2-4d6e-b09a-f63f31999df0 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:43.098003 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-a42103c5-56a2-4d6e-b09a-f63f31999df0 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:43.098003 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-a42103c5-56a2-4d6e-b09a-f63f31999df0 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:43.098714 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-a42103c5-56a2-4d6e-b09a-f63f31999df0 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:43.099195 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-a42103c5-56a2-4d6e-b09a-f63f31999df0 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:43.099758 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-a42103c5-56a2-4d6e-b09a-f63f31999df0 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:43.311338 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-a42103c5-56a2-4d6e-b09a-f63f31999df0 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5cfee7994ab404d974d86d77e075209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33bb29688304d0dae3cfdc0eb54b7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:43.319271 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-a42103c5-56a2-4d6e-b09a-f63f31999df0 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] 10.222.0.16 "GET /compute/v2.1/servers/fb16e6d4-57d8-4185-9955-ec1d261b365d" status: 200 len: 1575 microversion: 2.1 time: 0.238601 Oct 31 19:26:43.319851 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 392/785] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:26:43 2022] GET /compute/v2.1/servers/fb16e6d4-57d8-4185-9955-ec1d261b365d => generated 1575 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:26:43.590007 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-f80903e8-3fcb-4748-b614-8f1ac57e028f tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:26:43.590702 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-f80903e8-3fcb-4748-b614-8f1ac57e028f tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] [instance: 31bf9c76-adbe-4c58-8d9e-f332e36f86db] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:26:43.598648 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-f80903e8-3fcb-4748-b614-8f1ac57e028f tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:43.599341 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-f80903e8-3fcb-4748-b614-8f1ac57e028f tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:43.599812 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-f80903e8-3fcb-4748-b614-8f1ac57e028f tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:43.600570 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-f80903e8-3fcb-4748-b614-8f1ac57e028f tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:43.601036 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-f80903e8-3fcb-4748-b614-8f1ac57e028f tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:43.601463 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-f80903e8-3fcb-4748-b614-8f1ac57e028f tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:43.637860 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-f80903e8-3fcb-4748-b614-8f1ac57e028f tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:43.638340 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-f80903e8-3fcb-4748-b614-8f1ac57e028f tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:43.638772 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-f80903e8-3fcb-4748-b614-8f1ac57e028f tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:43.639213 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.objects.instance [None req-f80903e8-3fcb-4748-b614-8f1ac57e028f tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lazy-loading 'fault' on Instance uuid 31bf9c76-adbe-4c58-8d9e-f332e36f86db {{(pid=118726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 19:26:43.683955 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-f80903e8-3fcb-4748-b614-8f1ac57e028f tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e73a60801b04fc7acc4260297fdd2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808cc3e5392b4bb7a80b154a60f69ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:43.699483 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-f80903e8-3fcb-4748-b614-8f1ac57e028f tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] 10.222.0.16 "GET /compute/v2.1/servers/31bf9c76-adbe-4c58-8d9e-f332e36f86db" status: 200 len: 1230 microversion: 2.1 time: 0.110417 Oct 31 19:26:43.700112 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 394/786] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:26:43 2022] GET /compute/v2.1/servers/31bf9c76-adbe-4c58-8d9e-f332e36f86db => generated 1230 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 19:26:43.713662 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-1e2107ba-8bd7-4372-95f1-ceb0e8f8f9bc tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:26:43.714989 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-1e2107ba-8bd7-4372-95f1-ceb0e8f8f9bc tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:26:43.727776 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-1e2107ba-8bd7-4372-95f1-ceb0e8f8f9bc tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:43.728621 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-1e2107ba-8bd7-4372-95f1-ceb0e8f8f9bc tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:43.729347 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-1e2107ba-8bd7-4372-95f1-ceb0e8f8f9bc tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:43.730138 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-1e2107ba-8bd7-4372-95f1-ceb0e8f8f9bc tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:43.730674 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-1e2107ba-8bd7-4372-95f1-ceb0e8f8f9bc tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:43.731294 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-1e2107ba-8bd7-4372-95f1-ceb0e8f8f9bc tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:43.907759 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-1e2107ba-8bd7-4372-95f1-ceb0e8f8f9bc tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:43.916268 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-1e2107ba-8bd7-4372-95f1-ceb0e8f8f9bc tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:43.917767 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-1e2107ba-8bd7-4372-95f1-ceb0e8f8f9bc tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:43.918937 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-1e2107ba-8bd7-4372-95f1-ceb0e8f8f9bc tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29" status: 200 len: 1725 microversion: 2.20 time: 0.210597 Oct 31 19:26:43.919498 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 393/787] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 31 19:26:43 2022] GET /compute/v2.1/servers/3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29 => generated 1725 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 19:26:44.342976 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-5ea8032e-b7ef-442f-bf7a-ac1ad0964ac8 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:26:44.343660 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-5ea8032e-b7ef-442f-bf7a-ac1ad0964ac8 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] [instance: fb16e6d4-57d8-4185-9955-ec1d261b365d] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:26:44.351082 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-5ea8032e-b7ef-442f-bf7a-ac1ad0964ac8 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:44.351559 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-5ea8032e-b7ef-442f-bf7a-ac1ad0964ac8 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:44.352457 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-5ea8032e-b7ef-442f-bf7a-ac1ad0964ac8 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:44.353166 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-5ea8032e-b7ef-442f-bf7a-ac1ad0964ac8 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:44.353635 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-5ea8032e-b7ef-442f-bf7a-ac1ad0964ac8 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:44.354073 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-5ea8032e-b7ef-442f-bf7a-ac1ad0964ac8 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:44.490315 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-5ea8032e-b7ef-442f-bf7a-ac1ad0964ac8 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5cfee7994ab404d974d86d77e075209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33bb29688304d0dae3cfdc0eb54b7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:44.499055 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-5ea8032e-b7ef-442f-bf7a-ac1ad0964ac8 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] 10.222.0.16 "GET /compute/v2.1/servers/fb16e6d4-57d8-4185-9955-ec1d261b365d" status: 200 len: 1575 microversion: 2.1 time: 0.160182 Oct 31 19:26:44.499610 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 395/788] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:26:44 2022] GET /compute/v2.1/servers/fb16e6d4-57d8-4185-9955-ec1d261b365d => generated 1575 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:26:44.724499 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-69be1f1c-47d3-4e8a-956c-7a26604dc468 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:26:44.725853 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-69be1f1c-47d3-4e8a-956c-7a26604dc468 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] [instance: 31bf9c76-adbe-4c58-8d9e-f332e36f86db] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:26:44.733017 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-69be1f1c-47d3-4e8a-956c-7a26604dc468 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:44.733498 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-69be1f1c-47d3-4e8a-956c-7a26604dc468 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:44.733950 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-69be1f1c-47d3-4e8a-956c-7a26604dc468 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:44.734631 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-69be1f1c-47d3-4e8a-956c-7a26604dc468 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:44.735084 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-69be1f1c-47d3-4e8a-956c-7a26604dc468 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:44.735506 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-69be1f1c-47d3-4e8a-956c-7a26604dc468 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:44.748654 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.wsgi [None req-69be1f1c-47d3-4e8a-956c-7a26604dc468 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] HTTP exception thrown: Instance 31bf9c76-adbe-4c58-8d9e-f332e36f86db could not be found. Oct 31 19:26:44.750343 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-69be1f1c-47d3-4e8a-956c-7a26604dc468 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Request method failure captured: Oct 31 19:26:44.750343 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: request: GET /compute/v2.1/servers/31bf9c76-adbe-4c58-8d9e-f332e36f86db HTTP/1.1 Oct 31 19:26:44.750343 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Accept: application/json Oct 31 19:26:44.750343 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Accept-Encoding: identity Oct 31 19:26:44.750343 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Connection: close Oct 31 19:26:44.750343 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Content-Length: 0 Oct 31 19:26:44.750343 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Content-Type: application/json Oct 31 19:26:44.750343 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Host: 10.222.0.16 Oct 31 19:26:44.750343 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Openstack-System-Scope: None Oct 31 19:26:44.750343 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: User-Agent: python-urllib3/1.26.12 Oct 31 19:26:44.750343 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Auth-Token: gAAAAABjYCCEP_va2MgzPcthuSHgCO-BPB6CC52XadYYkIlt1kTr3a4jGaQpAoMWGCFpvXTcsn38gYUXHQZP7Pypanz3xtuz6RFPg-4WAMgRLoWDiY_wnErJHCB57XCJJPJMCE8jKET3LMMSL2hTR8Mlyuyt8G9Sd130QKwE-uUMJulgPVcVvCs Oct 31 19:26:44.750343 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Domain-Id: None Oct 31 19:26:44.750343 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Domain-Name: None Oct 31 19:26:44.750343 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Identity-Status: Confirmed Oct 31 19:26:44.750343 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Is-Admin-Project: True Oct 31 19:26:44.750343 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Project-Domain-Id: default Oct 31 19:26:44.750343 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Project-Domain-Name: Default Oct 31 19:26:44.750343 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Project-Id: 808cc3e5392b4bb7a80b154a60f69ee3 Oct 31 19:26:44.750343 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Project-Name: tempest-TestVolumeBootPattern-2094031800 Oct 31 19:26:44.750343 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Role: member,reader Oct 31 19:26:44.750343 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Roles: member,reader Oct 31 19:26:44.751886 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/808cc3e5392b4bb7a80b154a60f69ee3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_808cc3e5392b4bb7a80b154a60f69ee3", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/808cc3e5392b4bb7a80b154a60f69ee3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/808cc3e5392b4bb7a80b154a60f69ee3"}]}] Oct 31 19:26:44.751886 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Tenant: tempest-TestVolumeBootPattern-2094031800 Oct 31 19:26:44.751886 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Tenant-Id: 808cc3e5392b4bb7a80b154a60f69ee3 Oct 31 19:26:44.751886 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Tenant-Name: tempest-TestVolumeBootPattern-2094031800 Oct 31 19:26:44.751886 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User: tempest-TestVolumeBootPattern-2094031800-project Oct 31 19:26:44.751886 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User-Domain-Id: default Oct 31 19:26:44.751886 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User-Domain-Name: Default Oct 31 19:26:44.751886 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User-Id: 7e73a60801b04fc7acc4260297fdd2e4 Oct 31 19:26:44.751886 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User-Name: tempest-TestVolumeBootPattern-2094031800-project Oct 31 19:26:44.751886 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: method: > Oct 31 19:26:44.751886 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: exception: Instance 31bf9c76-adbe-4c58-8d9e-f332e36f86db could not be found. Oct 31 19:26:44.751886 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: action_args: {'id': '31bf9c76-adbe-4c58-8d9e-f332e36f86db'} Oct 31 19:26:44.752956 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 19:26:44.752956 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:26:44.752956 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 19:26:44.752956 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 19:26:44.752956 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 19:26:44.752956 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 19:26:44.752956 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 19:26:44.752956 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 19:26:44.752956 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 19:26:44.752956 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 19:26:44.752956 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31bf9c76-adbe-4c58-8d9e-f332e36f86db could not be found. Oct 31 19:26:44.752956 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:26:44.752956 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 19:26:44.752956 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:26:44.752956 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:26:44.752956 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 19:26:44.752956 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 19:26:44.752956 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 19:26:44.752956 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 19:26:44.752956 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 19:26:44.755021 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 19:26:44.755021 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 19:26:44.755021 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 19:26:44.755021 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 19:26:44.755021 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 19:26:44.755021 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 19:26:44.755021 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 19:26:44.755021 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31bf9c76-adbe-4c58-8d9e-f332e36f86db could not be found. Oct 31 19:26:44.755021 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:26:44.755021 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 19:26:44.755021 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:26:44.755021 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:26:44.755021 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 19:26:44.755021 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 19:26:44.755021 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 19:26:44.755021 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 19:26:44.755021 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31bf9c76-adbe-4c58-8d9e-f332e36f86db could not be found. Oct 31 19:26:44.755021 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:26:44.756342 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-69be1f1c-47d3-4e8a-956c-7a26604dc468 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Returning 404 to user: Instance 31bf9c76-adbe-4c58-8d9e-f332e36f86db could not be found. {{(pid=118727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 19:26:44.756342 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-69be1f1c-47d3-4e8a-956c-7a26604dc468 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] 10.222.0.16 "GET /compute/v2.1/servers/31bf9c76-adbe-4c58-8d9e-f332e36f86db" status: 404 len: 111 microversion: 2.1 time: 0.031901 Oct 31 19:26:44.756342 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 394/789] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:26:44 2022] GET /compute/v2.1/servers/31bf9c76-adbe-4c58-8d9e-f332e36f86db => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 19:26:44.919202 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-a9139c5d-f552-4005-bdd2-e9e940aec3f4 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-228659679", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-298495679", "security_groups": [{"name": "tempest-secgroup-smoke-698616685"}], "block_device_mapping_v2": [{"uuid": "012bff3e-71bd-4494-bb2f-4b6098954601", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "adb7c8f5-3156-4d00-ac4d-5e9b81d5fe3b"}]}} {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:26:44.944391 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-d1e95d2a-e06d-4ff9-9ce2-21096d26c759 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:26:44.945325 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-d1e95d2a-e06d-4ff9-9ce2-21096d26c759 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:26:44.951334 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-d1e95d2a-e06d-4ff9-9ce2-21096d26c759 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:44.951814 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-d1e95d2a-e06d-4ff9-9ce2-21096d26c759 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:44.952249 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-d1e95d2a-e06d-4ff9-9ce2-21096d26c759 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:44.952938 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-d1e95d2a-e06d-4ff9-9ce2-21096d26c759 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:44.953378 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-d1e95d2a-e06d-4ff9-9ce2-21096d26c759 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:44.954003 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-d1e95d2a-e06d-4ff9-9ce2-21096d26c759 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:45.039339 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.network.neutron [None req-a9139c5d-f552-4005-bdd2-e9e940aec3f4 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] validate_networks() for [('adb7c8f5-3156-4d00-ac4d-5e9b81d5fe3b', None, None, None, None, None)] {{(pid=118726) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 19:26:45.105242 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-d1e95d2a-e06d-4ff9-9ce2-21096d26c759 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:45.117079 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-d1e95d2a-e06d-4ff9-9ce2-21096d26c759 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:45.118798 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-d1e95d2a-e06d-4ff9-9ce2-21096d26c759 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:45.119953 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-d1e95d2a-e06d-4ff9-9ce2-21096d26c759 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29" status: 200 len: 1725 microversion: 2.20 time: 0.179452 Oct 31 19:26:45.120854 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 395/790] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 31 19:26:44 2022] GET /compute/v2.1/servers/3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29 => generated 1725 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 19:26:45.523530 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-30ad3d46-512b-455c-96f2-37e2ec452ecd tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:26:45.524260 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-30ad3d46-512b-455c-96f2-37e2ec452ecd tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] [instance: fb16e6d4-57d8-4185-9955-ec1d261b365d] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:26:45.530026 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-30ad3d46-512b-455c-96f2-37e2ec452ecd tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:45.530519 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-30ad3d46-512b-455c-96f2-37e2ec452ecd tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:45.530937 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-30ad3d46-512b-455c-96f2-37e2ec452ecd tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:45.531621 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-30ad3d46-512b-455c-96f2-37e2ec452ecd tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:45.532067 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-30ad3d46-512b-455c-96f2-37e2ec452ecd tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:45.532487 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-30ad3d46-512b-455c-96f2-37e2ec452ecd tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:45.583748 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.virt.hardware [None req-a9139c5d-f552-4005-bdd2-e9e940aec3f4 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Flavor limits 0:0:0 {{(pid=118726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 19:26:45.584163 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.virt.hardware [None req-a9139c5d-f552-4005-bdd2-e9e940aec3f4 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Image limits 0:0:0 {{(pid=118726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 19:26:45.584629 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.virt.hardware [None req-a9139c5d-f552-4005-bdd2-e9e940aec3f4 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Flavor pref 0:0:0 {{(pid=118726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 19:26:45.585029 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.virt.hardware [None req-a9139c5d-f552-4005-bdd2-e9e940aec3f4 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Image pref 0:0:0 {{(pid=118726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 19:26:45.585431 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.virt.hardware [None req-a9139c5d-f552-4005-bdd2-e9e940aec3f4 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 19:26:45.594251 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-a9139c5d-f552-4005-bdd2-e9e940aec3f4 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:45.594723 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-a9139c5d-f552-4005-bdd2-e9e940aec3f4 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:45.595341 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-a9139c5d-f552-4005-bdd2-e9e940aec3f4 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:45.596058 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-a9139c5d-f552-4005-bdd2-e9e940aec3f4 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:45.596666 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-a9139c5d-f552-4005-bdd2-e9e940aec3f4 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:45.597086 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-a9139c5d-f552-4005-bdd2-e9e940aec3f4 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:45.614725 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.quota [None req-a9139c5d-f552-4005-bdd2-e9e940aec3f4 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Getting quotas for project 808cc3e5392b4bb7a80b154a60f69ee3. Resources: {'instances', 'ram', 'cores'} {{(pid=118726) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 19:26:45.619921 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.quota [None req-a9139c5d-f552-4005-bdd2-e9e940aec3f4 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Getting quotas for user 7e73a60801b04fc7acc4260297fdd2e4 and project 808cc3e5392b4bb7a80b154a60f69ee3. Resources: {'instances', 'ram', 'cores'} {{(pid=118726) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 19:26:45.674275 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-30ad3d46-512b-455c-96f2-37e2ec452ecd tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5cfee7994ab404d974d86d77e075209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33bb29688304d0dae3cfdc0eb54b7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:45.682931 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-30ad3d46-512b-455c-96f2-37e2ec452ecd tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] 10.222.0.16 "GET /compute/v2.1/servers/fb16e6d4-57d8-4185-9955-ec1d261b365d" status: 200 len: 1562 microversion: 2.1 time: 0.163711 Oct 31 19:26:45.683907 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 396/791] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:26:45 2022] GET /compute/v2.1/servers/fb16e6d4-57d8-4185-9955-ec1d261b365d => generated 1562 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 19:26:45.687325 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-a9139c5d-f552-4005-bdd2-e9e940aec3f4 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Going to run 1 instances... {{(pid=118726) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 19:26:45.689568 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-a9139c5d-f552-4005-bdd2-e9e940aec3f4 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] [instance: 7e8be244-f6d6-40d1-9dba-6e0b134311ff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='012bff3e-71bd-4494-bb2f-4b6098954601',volume_size=None,volume_type=None)] {{(pid=118726) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 19:26:45.825478 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-a9139c5d-f552-4005-bdd2-e9e940aec3f4 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.910352 Oct 31 19:26:45.826419 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 396/792] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 31 19:26:44 2022] POST /compute/v2.1/servers => generated 405 bytes in 912 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 19:26:45.837907 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-c39b8471-68a6-4008-883c-c706b0bfa158 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:26:45.839057 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-c39b8471-68a6-4008-883c-c706b0bfa158 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] [instance: 7e8be244-f6d6-40d1-9dba-6e0b134311ff] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:26:45.907636 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-c39b8471-68a6-4008-883c-c706b0bfa158 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e73a60801b04fc7acc4260297fdd2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808cc3e5392b4bb7a80b154a60f69ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:45.915342 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-c39b8471-68a6-4008-883c-c706b0bfa158 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] 10.222.0.16 "GET /compute/v2.1/servers/7e8be244-f6d6-40d1-9dba-6e0b134311ff" status: 200 len: 1093 microversion: 2.1 time: 0.081159 Oct 31 19:26:45.916162 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 397/793] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:26:45 2022] GET /compute/v2.1/servers/7e8be244-f6d6-40d1-9dba-6e0b134311ff => generated 1093 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:26:46.144863 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-3e35790b-795e-4bc6-9670-747899e8d8bc tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:26:46.145568 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-3e35790b-795e-4bc6-9670-747899e8d8bc tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:26:46.151581 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-3e35790b-795e-4bc6-9670-747899e8d8bc tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:46.152064 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-3e35790b-795e-4bc6-9670-747899e8d8bc tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:46.152573 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-3e35790b-795e-4bc6-9670-747899e8d8bc tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:46.153267 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-3e35790b-795e-4bc6-9670-747899e8d8bc tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:46.153752 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-3e35790b-795e-4bc6-9670-747899e8d8bc tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:46.154301 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-3e35790b-795e-4bc6-9670-747899e8d8bc tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:46.292060 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-3e35790b-795e-4bc6-9670-747899e8d8bc tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:46.302080 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-3e35790b-795e-4bc6-9670-747899e8d8bc tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:46.303801 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-3e35790b-795e-4bc6-9670-747899e8d8bc tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:46.305148 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-3e35790b-795e-4bc6-9670-747899e8d8bc tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29" status: 200 len: 1725 microversion: 2.20 time: 0.164595 Oct 31 19:26:46.306028 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 397/794] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 31 19:26:46 2022] GET /compute/v2.1/servers/3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29 => generated 1725 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 19:26:46.939002 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-60306c68-ed5f-482d-8cc3-09e7da0a96dd tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:26:46.939609 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-60306c68-ed5f-482d-8cc3-09e7da0a96dd tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] [instance: 7e8be244-f6d6-40d1-9dba-6e0b134311ff] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:26:46.947275 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-60306c68-ed5f-482d-8cc3-09e7da0a96dd tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:46.947794 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-60306c68-ed5f-482d-8cc3-09e7da0a96dd tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:46.948229 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-60306c68-ed5f-482d-8cc3-09e7da0a96dd tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:46.948922 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-60306c68-ed5f-482d-8cc3-09e7da0a96dd tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:46.949382 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-60306c68-ed5f-482d-8cc3-09e7da0a96dd tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:46.949838 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-60306c68-ed5f-482d-8cc3-09e7da0a96dd tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:47.027746 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-60306c68-ed5f-482d-8cc3-09e7da0a96dd tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e73a60801b04fc7acc4260297fdd2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808cc3e5392b4bb7a80b154a60f69ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:47.035844 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-60306c68-ed5f-482d-8cc3-09e7da0a96dd tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] 10.222.0.16 "GET /compute/v2.1/servers/7e8be244-f6d6-40d1-9dba-6e0b134311ff" status: 200 len: 1199 microversion: 2.1 time: 0.100790 Oct 31 19:26:47.036546 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 398/795] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:26:46 2022] GET /compute/v2.1/servers/7e8be244-f6d6-40d1-9dba-6e0b134311ff => generated 1199 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 19:26:47.331858 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-1b30a3da-ff5c-46f4-8f0a-60f797c17e14 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:26:47.332531 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-1b30a3da-ff5c-46f4-8f0a-60f797c17e14 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:26:47.338947 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-1b30a3da-ff5c-46f4-8f0a-60f797c17e14 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:47.339430 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-1b30a3da-ff5c-46f4-8f0a-60f797c17e14 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:47.339886 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-1b30a3da-ff5c-46f4-8f0a-60f797c17e14 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:47.340577 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-1b30a3da-ff5c-46f4-8f0a-60f797c17e14 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:47.341245 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-1b30a3da-ff5c-46f4-8f0a-60f797c17e14 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:47.341680 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-1b30a3da-ff5c-46f4-8f0a-60f797c17e14 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:47.486732 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-1b30a3da-ff5c-46f4-8f0a-60f797c17e14 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:47.501457 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-1b30a3da-ff5c-46f4-8f0a-60f797c17e14 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:47.504506 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-1b30a3da-ff5c-46f4-8f0a-60f797c17e14 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:47.507812 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-1b30a3da-ff5c-46f4-8f0a-60f797c17e14 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29" status: 200 len: 1746 microversion: 2.20 time: 0.180112 Oct 31 19:26:47.508866 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 398/796] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 31 19:26:47 2022] GET /compute/v2.1/servers/3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29 => generated 1746 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 19:26:48.066606 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-64e162c3-c4f2-46f2-8e98-6e3876a96d2c tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:26:48.067689 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-64e162c3-c4f2-46f2-8e98-6e3876a96d2c tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] [instance: 7e8be244-f6d6-40d1-9dba-6e0b134311ff] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:26:48.087552 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-64e162c3-c4f2-46f2-8e98-6e3876a96d2c tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:48.092082 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-64e162c3-c4f2-46f2-8e98-6e3876a96d2c tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:48.092545 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-64e162c3-c4f2-46f2-8e98-6e3876a96d2c tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:48.093300 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-64e162c3-c4f2-46f2-8e98-6e3876a96d2c tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:48.093794 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-64e162c3-c4f2-46f2-8e98-6e3876a96d2c tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:48.094397 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-64e162c3-c4f2-46f2-8e98-6e3876a96d2c tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:48.388821 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-64e162c3-c4f2-46f2-8e98-6e3876a96d2c tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e73a60801b04fc7acc4260297fdd2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808cc3e5392b4bb7a80b154a60f69ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:48.391388 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG dbcounter [-] [118727] Writing DB stats nova_cell1:SELECT=100 {{(pid=118727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:26:48.398601 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-64e162c3-c4f2-46f2-8e98-6e3876a96d2c tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] 10.222.0.16 "GET /compute/v2.1/servers/7e8be244-f6d6-40d1-9dba-6e0b134311ff" status: 200 len: 1264 microversion: 2.1 time: 0.344072 Oct 31 19:26:48.399278 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 399/797] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:26:48 2022] GET /compute/v2.1/servers/7e8be244-f6d6-40d1-9dba-6e0b134311ff => generated 1264 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:26:48.534834 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-20d53d60-aba6-4d80-abbe-5f53b7d01ca4 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:26:48.535446 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-20d53d60-aba6-4d80-abbe-5f53b7d01ca4 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:26:48.541865 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-20d53d60-aba6-4d80-abbe-5f53b7d01ca4 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:48.542351 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-20d53d60-aba6-4d80-abbe-5f53b7d01ca4 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:48.542790 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-20d53d60-aba6-4d80-abbe-5f53b7d01ca4 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:48.543495 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-20d53d60-aba6-4d80-abbe-5f53b7d01ca4 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:48.543951 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-20d53d60-aba6-4d80-abbe-5f53b7d01ca4 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:48.544372 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-20d53d60-aba6-4d80-abbe-5f53b7d01ca4 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:48.675267 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-20d53d60-aba6-4d80-abbe-5f53b7d01ca4 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:48.683485 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-20d53d60-aba6-4d80-abbe-5f53b7d01ca4 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:48.684913 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-20d53d60-aba6-4d80-abbe-5f53b7d01ca4 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:48.686277 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-20d53d60-aba6-4d80-abbe-5f53b7d01ca4 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29" status: 200 len: 1746 microversion: 2.20 time: 0.155436 Oct 31 19:26:48.686859 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 399/798] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 31 19:26:48 2022] GET /compute/v2.1/servers/3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29 => generated 1746 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 19:26:48.818851 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [req-ade54c92-34db-475f-8264-3ddf5cecd440 req-a1cc8fff-399a-473b-8455-66c344b24e71 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e8be244-f6d6-40d1-9dba-6e0b134311ff", "tag": "4c57cc47-4bb3-47b7-af6b-73c6816c7ed6"}]} {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:26:48.830737 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [req-ade54c92-34db-475f-8264-3ddf5cecd440 req-a1cc8fff-399a-473b-8455-66c344b24e71 service nova] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:48.831219 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [req-ade54c92-34db-475f-8264-3ddf5cecd440 req-a1cc8fff-399a-473b-8455-66c344b24e71 service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:48.832422 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [req-ade54c92-34db-475f-8264-3ddf5cecd440 req-a1cc8fff-399a-473b-8455-66c344b24e71 service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:48.844879 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.compute.server_external_events [req-ade54c92-34db-475f-8264-3ddf5cecd440 req-a1cc8fff-399a-473b-8455-66c344b24e71 service nova] Creating event network-changed:4c57cc47-4bb3-47b7-af6b-73c6816c7ed6 for instance 7e8be244-f6d6-40d1-9dba-6e0b134311ff on hv-cinder-86309 Oct 31 19:26:48.850210 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [req-ade54c92-34db-475f-8264-3ddf5cecd440 req-a1cc8fff-399a-473b-8455-66c344b24e71 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035860 Oct 31 19:26:48.851128 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 400/799] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 31 19:26:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:26:49.422999 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-d6c6e235-6df7-4cb4-9fe0-2e068508a919 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:26:49.424352 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-d6c6e235-6df7-4cb4-9fe0-2e068508a919 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] [instance: 7e8be244-f6d6-40d1-9dba-6e0b134311ff] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:26:49.431422 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-d6c6e235-6df7-4cb4-9fe0-2e068508a919 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:49.431907 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-d6c6e235-6df7-4cb4-9fe0-2e068508a919 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:49.432610 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-d6c6e235-6df7-4cb4-9fe0-2e068508a919 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:49.433036 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-d6c6e235-6df7-4cb4-9fe0-2e068508a919 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:49.433484 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-d6c6e235-6df7-4cb4-9fe0-2e068508a919 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:49.434117 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-d6c6e235-6df7-4cb4-9fe0-2e068508a919 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:49.580258 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-d6c6e235-6df7-4cb4-9fe0-2e068508a919 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e73a60801b04fc7acc4260297fdd2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808cc3e5392b4bb7a80b154a60f69ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:49.588906 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-d6c6e235-6df7-4cb4-9fe0-2e068508a919 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] 10.222.0.16 "GET /compute/v2.1/servers/7e8be244-f6d6-40d1-9dba-6e0b134311ff" status: 200 len: 1264 microversion: 2.1 time: 0.170042 Oct 31 19:26:49.589469 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 400/800] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:26:49 2022] GET /compute/v2.1/servers/7e8be244-f6d6-40d1-9dba-6e0b134311ff => generated 1264 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:26:49.713109 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-c13c2297-9995-4412-a630-1d4411483543 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:26:49.713921 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-c13c2297-9995-4412-a630-1d4411483543 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:26:49.720469 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-c13c2297-9995-4412-a630-1d4411483543 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:49.720954 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-c13c2297-9995-4412-a630-1d4411483543 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:49.721387 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-c13c2297-9995-4412-a630-1d4411483543 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:49.722114 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-c13c2297-9995-4412-a630-1d4411483543 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:49.722565 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-c13c2297-9995-4412-a630-1d4411483543 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:49.722989 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-c13c2297-9995-4412-a630-1d4411483543 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:50.047124 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-c13c2297-9995-4412-a630-1d4411483543 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:50.055378 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-c13c2297-9995-4412-a630-1d4411483543 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:50.056804 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-c13c2297-9995-4412-a630-1d4411483543 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:50.058064 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-c13c2297-9995-4412-a630-1d4411483543 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29" status: 200 len: 1746 microversion: 2.20 time: 0.349323 Oct 31 19:26:50.066933 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 401/801] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 31 19:26:49 2022] GET /compute/v2.1/servers/3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29 => generated 1746 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 19:26:50.611401 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-8bf77175-74e1-4286-9355-bab199115624 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:26:50.612013 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-8bf77175-74e1-4286-9355-bab199115624 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] [instance: 7e8be244-f6d6-40d1-9dba-6e0b134311ff] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:26:50.619155 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-8bf77175-74e1-4286-9355-bab199115624 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:50.619865 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-8bf77175-74e1-4286-9355-bab199115624 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:50.620484 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-8bf77175-74e1-4286-9355-bab199115624 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:50.621454 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-8bf77175-74e1-4286-9355-bab199115624 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:50.622091 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-8bf77175-74e1-4286-9355-bab199115624 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:50.622783 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-8bf77175-74e1-4286-9355-bab199115624 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:50.820038 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-8bf77175-74e1-4286-9355-bab199115624 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e73a60801b04fc7acc4260297fdd2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808cc3e5392b4bb7a80b154a60f69ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:50.829685 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-8bf77175-74e1-4286-9355-bab199115624 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] 10.222.0.16 "GET /compute/v2.1/servers/7e8be244-f6d6-40d1-9dba-6e0b134311ff" status: 200 len: 1264 microversion: 2.1 time: 0.221729 Oct 31 19:26:50.842285 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 401/802] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:26:50 2022] GET /compute/v2.1/servers/7e8be244-f6d6-40d1-9dba-6e0b134311ff => generated 1264 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:26:51.084158 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-d374177d-b7f2-487f-85dc-9f06277c245f tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:26:51.085557 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-d374177d-b7f2-487f-85dc-9f06277c245f tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:26:51.092524 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-d374177d-b7f2-487f-85dc-9f06277c245f tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:51.093403 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-d374177d-b7f2-487f-85dc-9f06277c245f tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:51.093711 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-d374177d-b7f2-487f-85dc-9f06277c245f tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:51.094658 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-d374177d-b7f2-487f-85dc-9f06277c245f tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:51.095526 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-d374177d-b7f2-487f-85dc-9f06277c245f tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:51.096052 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-d374177d-b7f2-487f-85dc-9f06277c245f tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:51.262402 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-d374177d-b7f2-487f-85dc-9f06277c245f tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:51.274794 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-d374177d-b7f2-487f-85dc-9f06277c245f tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:51.276444 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-d374177d-b7f2-487f-85dc-9f06277c245f tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:51.277628 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-d374177d-b7f2-487f-85dc-9f06277c245f tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29" status: 200 len: 1741 microversion: 2.20 time: 0.197423 Oct 31 19:26:51.278357 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 402/803] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 31 19:26:51 2022] GET /compute/v2.1/servers/3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29 => generated 1741 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 19:26:51.855804 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-45c26294-d75c-4a60-98ec-7d7bbc87a9c9 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:26:51.856803 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-45c26294-d75c-4a60-98ec-7d7bbc87a9c9 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] [instance: 7e8be244-f6d6-40d1-9dba-6e0b134311ff] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:26:51.864573 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-45c26294-d75c-4a60-98ec-7d7bbc87a9c9 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:51.865472 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-45c26294-d75c-4a60-98ec-7d7bbc87a9c9 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:51.866087 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-45c26294-d75c-4a60-98ec-7d7bbc87a9c9 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:51.866964 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-45c26294-d75c-4a60-98ec-7d7bbc87a9c9 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:51.867590 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-45c26294-d75c-4a60-98ec-7d7bbc87a9c9 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:51.868178 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-45c26294-d75c-4a60-98ec-7d7bbc87a9c9 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:52.034224 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-45c26294-d75c-4a60-98ec-7d7bbc87a9c9 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e73a60801b04fc7acc4260297fdd2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808cc3e5392b4bb7a80b154a60f69ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:52.044468 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-45c26294-d75c-4a60-98ec-7d7bbc87a9c9 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] 10.222.0.16 "GET /compute/v2.1/servers/7e8be244-f6d6-40d1-9dba-6e0b134311ff" status: 200 len: 1264 microversion: 2.1 time: 0.192878 Oct 31 19:26:52.045435 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 402/804] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:26:51 2022] GET /compute/v2.1/servers/7e8be244-f6d6-40d1-9dba-6e0b134311ff => generated 1264 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:26:52.307819 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-218a9033-6b7b-4ff0-b94e-d22420090b79 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:26:52.310320 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-218a9033-6b7b-4ff0-b94e-d22420090b79 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:26:52.318219 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-218a9033-6b7b-4ff0-b94e-d22420090b79 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:52.319183 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-218a9033-6b7b-4ff0-b94e-d22420090b79 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:52.320071 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-218a9033-6b7b-4ff0-b94e-d22420090b79 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:52.321100 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-218a9033-6b7b-4ff0-b94e-d22420090b79 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:52.321773 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-218a9033-6b7b-4ff0-b94e-d22420090b79 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:52.322320 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-218a9033-6b7b-4ff0-b94e-d22420090b79 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:52.527792 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-218a9033-6b7b-4ff0-b94e-d22420090b79 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:52.537742 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-218a9033-6b7b-4ff0-b94e-d22420090b79 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:52.539402 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-218a9033-6b7b-4ff0-b94e-d22420090b79 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:52.541229 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-218a9033-6b7b-4ff0-b94e-d22420090b79 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29" status: 200 len: 1741 microversion: 2.20 time: 0.238001 Oct 31 19:26:52.542291 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 403/805] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 31 19:26:52 2022] GET /compute/v2.1/servers/3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29 => generated 1741 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 19:26:52.751896 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [req-debd5a08-a35c-4ade-be38-9dd892c09ee1 req-46ae792e-2fce-498e-9d3f-971a48c53f43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29", "name": "network-vif-plugged", "status": "completed", "tag": "0e51264f-300d-49b6-9f03-c22ed061b801"}]} {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:26:52.788278 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [req-debd5a08-a35c-4ade-be38-9dd892c09ee1 req-46ae792e-2fce-498e-9d3f-971a48c53f43 service nova] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:52.788887 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [req-debd5a08-a35c-4ade-be38-9dd892c09ee1 req-46ae792e-2fce-498e-9d3f-971a48c53f43 service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:52.789389 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [req-debd5a08-a35c-4ade-be38-9dd892c09ee1 req-46ae792e-2fce-498e-9d3f-971a48c53f43 service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:52.810383 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.compute.server_external_events [req-debd5a08-a35c-4ade-be38-9dd892c09ee1 req-46ae792e-2fce-498e-9d3f-971a48c53f43 service nova] Creating event network-vif-plugged:0e51264f-300d-49b6-9f03-c22ed061b801 for instance 3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29 on hv-cinder-86309 Oct 31 19:26:52.817796 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [req-debd5a08-a35c-4ade-be38-9dd892c09ee1 req-46ae792e-2fce-498e-9d3f-971a48c53f43 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070747 Oct 31 19:26:52.820956 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 403/806] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 31 19:26:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:26:53.068752 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-ebef20d8-13a3-4cca-8b17-b1bdecdc5da5 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:26:53.069844 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-ebef20d8-13a3-4cca-8b17-b1bdecdc5da5 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] [instance: 7e8be244-f6d6-40d1-9dba-6e0b134311ff] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:26:53.092437 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-ebef20d8-13a3-4cca-8b17-b1bdecdc5da5 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:53.092951 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-ebef20d8-13a3-4cca-8b17-b1bdecdc5da5 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:53.093395 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-ebef20d8-13a3-4cca-8b17-b1bdecdc5da5 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:53.094203 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-ebef20d8-13a3-4cca-8b17-b1bdecdc5da5 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:53.094766 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-ebef20d8-13a3-4cca-8b17-b1bdecdc5da5 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:53.096091 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-ebef20d8-13a3-4cca-8b17-b1bdecdc5da5 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:53.264498 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-ebef20d8-13a3-4cca-8b17-b1bdecdc5da5 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e73a60801b04fc7acc4260297fdd2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808cc3e5392b4bb7a80b154a60f69ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:53.272126 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-ebef20d8-13a3-4cca-8b17-b1bdecdc5da5 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] 10.222.0.16 "GET /compute/v2.1/servers/7e8be244-f6d6-40d1-9dba-6e0b134311ff" status: 200 len: 1264 microversion: 2.1 time: 0.207746 Oct 31 19:26:53.272694 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 404/807] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:26:53 2022] GET /compute/v2.1/servers/7e8be244-f6d6-40d1-9dba-6e0b134311ff => generated 1264 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 19:26:53.570691 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-a908bd15-5aa7-4c39-a369-6b63e1c9c32e tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:26:53.572129 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-a908bd15-5aa7-4c39-a369-6b63e1c9c32e tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:26:53.581673 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-a908bd15-5aa7-4c39-a369-6b63e1c9c32e tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:53.582403 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-a908bd15-5aa7-4c39-a369-6b63e1c9c32e tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:53.583022 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-a908bd15-5aa7-4c39-a369-6b63e1c9c32e tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:53.583865 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-a908bd15-5aa7-4c39-a369-6b63e1c9c32e tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:53.584606 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-a908bd15-5aa7-4c39-a369-6b63e1c9c32e tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:53.585180 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-a908bd15-5aa7-4c39-a369-6b63e1c9c32e tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:53.803774 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-a908bd15-5aa7-4c39-a369-6b63e1c9c32e tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:53.812656 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-a908bd15-5aa7-4c39-a369-6b63e1c9c32e tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:53.814498 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-a908bd15-5aa7-4c39-a369-6b63e1c9c32e tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:53.816639 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-a908bd15-5aa7-4c39-a369-6b63e1c9c32e tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29" status: 200 len: 1741 microversion: 2.20 time: 0.250776 Oct 31 19:26:53.817470 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 404/808] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 31 19:26:53 2022] GET /compute/v2.1/servers/3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29 => generated 1741 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 19:26:54.298797 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-0de3d6c6-251d-414b-9028-b8c4b3c4ace7 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:26:54.300334 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-0de3d6c6-251d-414b-9028-b8c4b3c4ace7 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] [instance: 7e8be244-f6d6-40d1-9dba-6e0b134311ff] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:26:54.311296 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-0de3d6c6-251d-414b-9028-b8c4b3c4ace7 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:54.312208 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-0de3d6c6-251d-414b-9028-b8c4b3c4ace7 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:54.313412 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-0de3d6c6-251d-414b-9028-b8c4b3c4ace7 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:54.314378 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-0de3d6c6-251d-414b-9028-b8c4b3c4ace7 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:54.315061 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-0de3d6c6-251d-414b-9028-b8c4b3c4ace7 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:54.315963 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-0de3d6c6-251d-414b-9028-b8c4b3c4ace7 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:54.477201 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-0de3d6c6-251d-414b-9028-b8c4b3c4ace7 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e73a60801b04fc7acc4260297fdd2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808cc3e5392b4bb7a80b154a60f69ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:54.486083 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-0de3d6c6-251d-414b-9028-b8c4b3c4ace7 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] 10.222.0.16 "GET /compute/v2.1/servers/7e8be244-f6d6-40d1-9dba-6e0b134311ff" status: 200 len: 1264 microversion: 2.1 time: 0.192588 Oct 31 19:26:54.486821 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 405/809] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:26:54 2022] GET /compute/v2.1/servers/7e8be244-f6d6-40d1-9dba-6e0b134311ff => generated 1264 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:26:54.843299 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-10b841ce-03d6-4a1b-a0b9-4e373e1a4afc tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:26:54.844538 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-10b841ce-03d6-4a1b-a0b9-4e373e1a4afc tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:26:54.855418 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-10b841ce-03d6-4a1b-a0b9-4e373e1a4afc tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:54.856286 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-10b841ce-03d6-4a1b-a0b9-4e373e1a4afc tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:54.858773 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-10b841ce-03d6-4a1b-a0b9-4e373e1a4afc tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:54.860530 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-10b841ce-03d6-4a1b-a0b9-4e373e1a4afc tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:54.861338 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-10b841ce-03d6-4a1b-a0b9-4e373e1a4afc tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:54.861821 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-10b841ce-03d6-4a1b-a0b9-4e373e1a4afc tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:55.029027 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-10b841ce-03d6-4a1b-a0b9-4e373e1a4afc tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:55.055636 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-10b841ce-03d6-4a1b-a0b9-4e373e1a4afc tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:55.057301 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-10b841ce-03d6-4a1b-a0b9-4e373e1a4afc tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:55.059632 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-10b841ce-03d6-4a1b-a0b9-4e373e1a4afc tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29" status: 200 len: 1741 microversion: 2.20 time: 0.220666 Oct 31 19:26:55.067263 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 405/810] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 31 19:26:54 2022] GET /compute/v2.1/servers/3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29 => generated 1741 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 19:26:55.508899 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-4ad726ef-20e6-4ff1-bdcf-93a715688349 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:26:55.510219 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-4ad726ef-20e6-4ff1-bdcf-93a715688349 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] [instance: 7e8be244-f6d6-40d1-9dba-6e0b134311ff] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:26:55.516604 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-4ad726ef-20e6-4ff1-bdcf-93a715688349 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:55.518615 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-4ad726ef-20e6-4ff1-bdcf-93a715688349 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:55.519903 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-4ad726ef-20e6-4ff1-bdcf-93a715688349 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:55.522622 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-4ad726ef-20e6-4ff1-bdcf-93a715688349 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:55.524257 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-4ad726ef-20e6-4ff1-bdcf-93a715688349 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:55.525538 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-4ad726ef-20e6-4ff1-bdcf-93a715688349 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:55.683501 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-4ad726ef-20e6-4ff1-bdcf-93a715688349 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e73a60801b04fc7acc4260297fdd2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808cc3e5392b4bb7a80b154a60f69ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:55.694897 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-4ad726ef-20e6-4ff1-bdcf-93a715688349 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] 10.222.0.16 "GET /compute/v2.1/servers/7e8be244-f6d6-40d1-9dba-6e0b134311ff" status: 200 len: 1264 microversion: 2.1 time: 0.189839 Oct 31 19:26:55.695792 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 406/811] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:26:55 2022] GET /compute/v2.1/servers/7e8be244-f6d6-40d1-9dba-6e0b134311ff => generated 1264 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:26:56.093289 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-95d182a9-c63d-4421-85c4-f4a95a2a45cd tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:26:56.093935 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-95d182a9-c63d-4421-85c4-f4a95a2a45cd tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:26:56.096536 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG dbcounter [-] [118726] Writing DB stats nova_cell0:SELECT=2 {{(pid=118726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:26:56.097924 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG dbcounter [-] [118726] Writing DB stats nova_cell0:SELECT=6 {{(pid=118726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:26:56.105329 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-95d182a9-c63d-4421-85c4-f4a95a2a45cd tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:56.106443 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-95d182a9-c63d-4421-85c4-f4a95a2a45cd tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:56.107660 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-95d182a9-c63d-4421-85c4-f4a95a2a45cd tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:56.108946 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-95d182a9-c63d-4421-85c4-f4a95a2a45cd tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:56.110317 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-95d182a9-c63d-4421-85c4-f4a95a2a45cd tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:56.111273 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-95d182a9-c63d-4421-85c4-f4a95a2a45cd tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:56.257501 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-95d182a9-c63d-4421-85c4-f4a95a2a45cd tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:56.265955 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-95d182a9-c63d-4421-85c4-f4a95a2a45cd tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:56.267401 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-95d182a9-c63d-4421-85c4-f4a95a2a45cd tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:56.268563 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-95d182a9-c63d-4421-85c4-f4a95a2a45cd tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29" status: 200 len: 1741 microversion: 2.20 time: 0.179865 Oct 31 19:26:56.269786 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 406/812] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 31 19:26:56 2022] GET /compute/v2.1/servers/3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29 => generated 1741 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 19:26:56.717809 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-75c3ef44-703c-4714-8e34-a5525aa91ae3 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:26:56.718423 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-75c3ef44-703c-4714-8e34-a5525aa91ae3 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] [instance: 7e8be244-f6d6-40d1-9dba-6e0b134311ff] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:26:56.722389 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG dbcounter [-] [118727] Writing DB stats nova_cell0:SELECT=2 {{(pid=118727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:26:56.727406 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-75c3ef44-703c-4714-8e34-a5525aa91ae3 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:56.727896 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-75c3ef44-703c-4714-8e34-a5525aa91ae3 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:56.728665 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-75c3ef44-703c-4714-8e34-a5525aa91ae3 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:56.729600 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-75c3ef44-703c-4714-8e34-a5525aa91ae3 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:56.730080 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-75c3ef44-703c-4714-8e34-a5525aa91ae3 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:56.730505 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-75c3ef44-703c-4714-8e34-a5525aa91ae3 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:56.891158 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-75c3ef44-703c-4714-8e34-a5525aa91ae3 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e73a60801b04fc7acc4260297fdd2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808cc3e5392b4bb7a80b154a60f69ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:56.900373 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-75c3ef44-703c-4714-8e34-a5525aa91ae3 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] 10.222.0.16 "GET /compute/v2.1/servers/7e8be244-f6d6-40d1-9dba-6e0b134311ff" status: 200 len: 1264 microversion: 2.1 time: 0.186670 Oct 31 19:26:56.901907 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 407/813] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:26:56 2022] GET /compute/v2.1/servers/7e8be244-f6d6-40d1-9dba-6e0b134311ff => generated 1264 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:26:57.299664 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-c26337e9-4f50-48bb-b828-54d6466bd420 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:26:57.300274 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-c26337e9-4f50-48bb-b828-54d6466bd420 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:26:57.307374 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-c26337e9-4f50-48bb-b828-54d6466bd420 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:57.308102 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-c26337e9-4f50-48bb-b828-54d6466bd420 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:57.308801 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-c26337e9-4f50-48bb-b828-54d6466bd420 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:57.309842 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-c26337e9-4f50-48bb-b828-54d6466bd420 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:57.310355 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-c26337e9-4f50-48bb-b828-54d6466bd420 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:57.310948 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-c26337e9-4f50-48bb-b828-54d6466bd420 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:57.452220 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-c26337e9-4f50-48bb-b828-54d6466bd420 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:57.461157 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-c26337e9-4f50-48bb-b828-54d6466bd420 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:57.462815 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-c26337e9-4f50-48bb-b828-54d6466bd420 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:57.464251 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-c26337e9-4f50-48bb-b828-54d6466bd420 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29" status: 200 len: 1741 microversion: 2.20 time: 0.168827 Oct 31 19:26:57.465017 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 407/814] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 31 19:26:57 2022] GET /compute/v2.1/servers/3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29 => generated 1741 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 19:26:57.923782 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-e272737f-fbc1-437e-b1f0-207b1a769aff tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:26:57.924396 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-e272737f-fbc1-437e-b1f0-207b1a769aff tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] [instance: 7e8be244-f6d6-40d1-9dba-6e0b134311ff] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:26:57.932310 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-e272737f-fbc1-437e-b1f0-207b1a769aff tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:57.933322 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-e272737f-fbc1-437e-b1f0-207b1a769aff tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:57.933991 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-e272737f-fbc1-437e-b1f0-207b1a769aff tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:57.934914 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-e272737f-fbc1-437e-b1f0-207b1a769aff tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:57.935488 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-e272737f-fbc1-437e-b1f0-207b1a769aff tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:57.936128 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-e272737f-fbc1-437e-b1f0-207b1a769aff tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:58.077889 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-e272737f-fbc1-437e-b1f0-207b1a769aff tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e73a60801b04fc7acc4260297fdd2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808cc3e5392b4bb7a80b154a60f69ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:58.086461 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-e272737f-fbc1-437e-b1f0-207b1a769aff tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] 10.222.0.16 "GET /compute/v2.1/servers/7e8be244-f6d6-40d1-9dba-6e0b134311ff" status: 200 len: 1264 microversion: 2.1 time: 0.166750 Oct 31 19:26:58.093827 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 408/815] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:26:57 2022] GET /compute/v2.1/servers/7e8be244-f6d6-40d1-9dba-6e0b134311ff => generated 1264 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:26:58.491542 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-c15ab0c9-6383-458f-9cc3-1d0985574629 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:26:58.492756 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-c15ab0c9-6383-458f-9cc3-1d0985574629 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:26:58.500025 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-c15ab0c9-6383-458f-9cc3-1d0985574629 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:58.500515 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-c15ab0c9-6383-458f-9cc3-1d0985574629 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:58.500950 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-c15ab0c9-6383-458f-9cc3-1d0985574629 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:58.501669 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-c15ab0c9-6383-458f-9cc3-1d0985574629 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:58.502313 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-c15ab0c9-6383-458f-9cc3-1d0985574629 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:58.502935 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-c15ab0c9-6383-458f-9cc3-1d0985574629 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:58.644277 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-c15ab0c9-6383-458f-9cc3-1d0985574629 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:58.652346 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-c15ab0c9-6383-458f-9cc3-1d0985574629 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:58.653828 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-c15ab0c9-6383-458f-9cc3-1d0985574629 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:58.655008 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-c15ab0c9-6383-458f-9cc3-1d0985574629 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29" status: 200 len: 1741 microversion: 2.20 time: 0.167383 Oct 31 19:26:58.655747 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 408/816] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 31 19:26:58 2022] GET /compute/v2.1/servers/3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29 => generated 1741 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 19:26:59.109887 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-bf29c3ed-5355-4d12-ab32-eb3b8881fdc2 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:26:59.110989 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-bf29c3ed-5355-4d12-ab32-eb3b8881fdc2 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] [instance: 7e8be244-f6d6-40d1-9dba-6e0b134311ff] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:26:59.113973 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG dbcounter [-] [118727] Writing DB stats nova_api:SELECT=65 {{(pid=118727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:26:59.118628 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-bf29c3ed-5355-4d12-ab32-eb3b8881fdc2 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:59.119537 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-bf29c3ed-5355-4d12-ab32-eb3b8881fdc2 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:59.119537 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-bf29c3ed-5355-4d12-ab32-eb3b8881fdc2 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:59.120927 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-bf29c3ed-5355-4d12-ab32-eb3b8881fdc2 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:59.122398 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-bf29c3ed-5355-4d12-ab32-eb3b8881fdc2 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:59.122987 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-bf29c3ed-5355-4d12-ab32-eb3b8881fdc2 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:59.262296 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-bf29c3ed-5355-4d12-ab32-eb3b8881fdc2 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e73a60801b04fc7acc4260297fdd2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808cc3e5392b4bb7a80b154a60f69ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:59.278261 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-bf29c3ed-5355-4d12-ab32-eb3b8881fdc2 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] 10.222.0.16 "GET /compute/v2.1/servers/7e8be244-f6d6-40d1-9dba-6e0b134311ff" status: 200 len: 1264 microversion: 2.1 time: 0.171933 Oct 31 19:26:59.279103 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 409/817] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:26:59 2022] GET /compute/v2.1/servers/7e8be244-f6d6-40d1-9dba-6e0b134311ff => generated 1264 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:26:59.684445 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-77d11c21-7b78-46b5-bb48-7761333ce89c tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:26:59.685969 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-77d11c21-7b78-46b5-bb48-7761333ce89c tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:26:59.693080 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-77d11c21-7b78-46b5-bb48-7761333ce89c tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:59.693708 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-77d11c21-7b78-46b5-bb48-7761333ce89c tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:59.694146 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-77d11c21-7b78-46b5-bb48-7761333ce89c tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:59.694841 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-77d11c21-7b78-46b5-bb48-7761333ce89c tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:26:59.695286 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-77d11c21-7b78-46b5-bb48-7761333ce89c tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:26:59.695699 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-77d11c21-7b78-46b5-bb48-7761333ce89c tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:26:59.843765 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-77d11c21-7b78-46b5-bb48-7761333ce89c tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:59.852719 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-77d11c21-7b78-46b5-bb48-7761333ce89c tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:59.853692 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-77d11c21-7b78-46b5-bb48-7761333ce89c tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:26:59.855304 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-77d11c21-7b78-46b5-bb48-7761333ce89c tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29" status: 200 len: 1741 microversion: 2.20 time: 0.174273 Oct 31 19:26:59.855304 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 409/818] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 31 19:26:59 2022] GET /compute/v2.1/servers/3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29 => generated 1741 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 19:27:00.302730 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-e2a75347-d57d-47bb-baad-2fe5f77c67c8 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:27:00.303293 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-e2a75347-d57d-47bb-baad-2fe5f77c67c8 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] [instance: 7e8be244-f6d6-40d1-9dba-6e0b134311ff] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:27:00.309526 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-e2a75347-d57d-47bb-baad-2fe5f77c67c8 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:27:00.310162 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-e2a75347-d57d-47bb-baad-2fe5f77c67c8 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:27:00.310590 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-e2a75347-d57d-47bb-baad-2fe5f77c67c8 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:27:00.311280 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-e2a75347-d57d-47bb-baad-2fe5f77c67c8 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:27:00.311731 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-e2a75347-d57d-47bb-baad-2fe5f77c67c8 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:27:00.312156 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-e2a75347-d57d-47bb-baad-2fe5f77c67c8 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:27:00.447243 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-e2a75347-d57d-47bb-baad-2fe5f77c67c8 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e73a60801b04fc7acc4260297fdd2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808cc3e5392b4bb7a80b154a60f69ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:27:00.454960 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-e2a75347-d57d-47bb-baad-2fe5f77c67c8 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] 10.222.0.16 "GET /compute/v2.1/servers/7e8be244-f6d6-40d1-9dba-6e0b134311ff" status: 200 len: 1264 microversion: 2.1 time: 0.156703 Oct 31 19:27:00.455534 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 410/819] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:27:00 2022] GET /compute/v2.1/servers/7e8be244-f6d6-40d1-9dba-6e0b134311ff => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:27:00.882048 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-e04ca6c7-55ca-4dcd-ba77-0e73ce847b59 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:27:00.882661 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-e04ca6c7-55ca-4dcd-ba77-0e73ce847b59 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:27:00.888930 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-e04ca6c7-55ca-4dcd-ba77-0e73ce847b59 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:27:00.889411 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-e04ca6c7-55ca-4dcd-ba77-0e73ce847b59 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:27:00.889884 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-e04ca6c7-55ca-4dcd-ba77-0e73ce847b59 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:27:00.890572 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-e04ca6c7-55ca-4dcd-ba77-0e73ce847b59 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:27:00.891029 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-e04ca6c7-55ca-4dcd-ba77-0e73ce847b59 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:27:00.891460 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-e04ca6c7-55ca-4dcd-ba77-0e73ce847b59 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:27:00.906250 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG dbcounter [-] [118726] Writing DB stats nova_cell1:SELECT=100 {{(pid=118726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:27:01.017148 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-e04ca6c7-55ca-4dcd-ba77-0e73ce847b59 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:27:01.025650 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-e04ca6c7-55ca-4dcd-ba77-0e73ce847b59 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:27:01.027098 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-e04ca6c7-55ca-4dcd-ba77-0e73ce847b59 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:27:01.028255 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-e04ca6c7-55ca-4dcd-ba77-0e73ce847b59 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29" status: 200 len: 1723 microversion: 2.20 time: 0.150175 Oct 31 19:27:01.028813 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 410/820] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 31 19:27:00 2022] GET /compute/v2.1/servers/3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 19:27:01.478677 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-d5875a32-d694-459d-8150-80a8068c887f tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:27:01.479287 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-d5875a32-d694-459d-8150-80a8068c887f tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] [instance: 7e8be244-f6d6-40d1-9dba-6e0b134311ff] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:27:01.485755 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-d5875a32-d694-459d-8150-80a8068c887f tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:27:01.486236 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-d5875a32-d694-459d-8150-80a8068c887f tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:27:01.486666 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-d5875a32-d694-459d-8150-80a8068c887f tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:27:01.487985 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-d5875a32-d694-459d-8150-80a8068c887f tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:27:01.488440 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-d5875a32-d694-459d-8150-80a8068c887f tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:27:01.488862 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-d5875a32-d694-459d-8150-80a8068c887f tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:27:01.622233 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-d5875a32-d694-459d-8150-80a8068c887f tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e73a60801b04fc7acc4260297fdd2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808cc3e5392b4bb7a80b154a60f69ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:27:01.629764 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-d5875a32-d694-459d-8150-80a8068c887f tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] 10.222.0.16 "GET /compute/v2.1/servers/7e8be244-f6d6-40d1-9dba-6e0b134311ff" status: 200 len: 1264 microversion: 2.1 time: 0.154879 Oct 31 19:27:01.630329 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 411/821] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:27:01 2022] GET /compute/v2.1/servers/7e8be244-f6d6-40d1-9dba-6e0b134311ff => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:27:02.055049 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-213854fc-74f3-4de2-97f9-469d68baacaa tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:27:02.055588 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-213854fc-74f3-4de2-97f9-469d68baacaa tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:27:02.062007 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-213854fc-74f3-4de2-97f9-469d68baacaa tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:27:02.062496 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-213854fc-74f3-4de2-97f9-469d68baacaa tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:27:02.062931 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-213854fc-74f3-4de2-97f9-469d68baacaa tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:27:02.063623 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-213854fc-74f3-4de2-97f9-469d68baacaa tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:27:02.064078 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-213854fc-74f3-4de2-97f9-469d68baacaa tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:27:02.064501 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-213854fc-74f3-4de2-97f9-469d68baacaa tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:27:02.193757 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-213854fc-74f3-4de2-97f9-469d68baacaa tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:27:02.202626 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-213854fc-74f3-4de2-97f9-469d68baacaa tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:27:02.204388 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-213854fc-74f3-4de2-97f9-469d68baacaa tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:27:02.205561 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-213854fc-74f3-4de2-97f9-469d68baacaa tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29" status: 200 len: 1723 microversion: 2.20 time: 0.154545 Oct 31 19:27:02.206149 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 411/822] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 31 19:27:02 2022] GET /compute/v2.1/servers/3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 19:27:02.652219 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-ba4438d7-f2e5-4b48-b625-8620bd709585 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:27:02.652768 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-ba4438d7-f2e5-4b48-b625-8620bd709585 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] [instance: 7e8be244-f6d6-40d1-9dba-6e0b134311ff] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:27:02.658831 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-ba4438d7-f2e5-4b48-b625-8620bd709585 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:27:02.660086 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-ba4438d7-f2e5-4b48-b625-8620bd709585 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:27:02.660592 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-ba4438d7-f2e5-4b48-b625-8620bd709585 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:27:02.661229 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-ba4438d7-f2e5-4b48-b625-8620bd709585 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:27:02.661709 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-ba4438d7-f2e5-4b48-b625-8620bd709585 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:27:02.662143 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-ba4438d7-f2e5-4b48-b625-8620bd709585 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:27:02.794245 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-ba4438d7-f2e5-4b48-b625-8620bd709585 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e73a60801b04fc7acc4260297fdd2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808cc3e5392b4bb7a80b154a60f69ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:27:02.802564 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-ba4438d7-f2e5-4b48-b625-8620bd709585 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] 10.222.0.16 "GET /compute/v2.1/servers/7e8be244-f6d6-40d1-9dba-6e0b134311ff" status: 200 len: 1264 microversion: 2.1 time: 0.154183 Oct 31 19:27:02.803117 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 412/823] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:27:02 2022] GET /compute/v2.1/servers/7e8be244-f6d6-40d1-9dba-6e0b134311ff => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:27:03.231280 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-d780dade-7844-4574-9c70-1c6221e69809 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:27:03.231889 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-d780dade-7844-4574-9c70-1c6221e69809 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:27:03.238274 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-d780dade-7844-4574-9c70-1c6221e69809 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:27:03.239260 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-d780dade-7844-4574-9c70-1c6221e69809 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:27:03.239692 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-d780dade-7844-4574-9c70-1c6221e69809 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:27:03.240380 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-d780dade-7844-4574-9c70-1c6221e69809 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:27:03.240835 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-d780dade-7844-4574-9c70-1c6221e69809 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:27:03.241258 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-d780dade-7844-4574-9c70-1c6221e69809 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:27:03.369041 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-d780dade-7844-4574-9c70-1c6221e69809 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:27:03.376959 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-d780dade-7844-4574-9c70-1c6221e69809 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:27:03.378419 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-d780dade-7844-4574-9c70-1c6221e69809 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:27:03.380200 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-d780dade-7844-4574-9c70-1c6221e69809 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29" status: 200 len: 1723 microversion: 2.20 time: 0.152840 Oct 31 19:27:03.380821 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 412/824] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 31 19:27:03 2022] GET /compute/v2.1/servers/3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 19:27:03.825591 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-170ab3b5-551e-467e-8334-46a09cc750f4 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:27:03.826224 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-170ab3b5-551e-467e-8334-46a09cc750f4 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] [instance: 7e8be244-f6d6-40d1-9dba-6e0b134311ff] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:27:03.833120 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-170ab3b5-551e-467e-8334-46a09cc750f4 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:27:03.833539 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-170ab3b5-551e-467e-8334-46a09cc750f4 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:27:03.833996 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-170ab3b5-551e-467e-8334-46a09cc750f4 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:27:03.834679 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-170ab3b5-551e-467e-8334-46a09cc750f4 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:27:03.835132 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-170ab3b5-551e-467e-8334-46a09cc750f4 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:27:03.835553 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-170ab3b5-551e-467e-8334-46a09cc750f4 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:27:03.981312 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-170ab3b5-551e-467e-8334-46a09cc750f4 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e73a60801b04fc7acc4260297fdd2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808cc3e5392b4bb7a80b154a60f69ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:27:03.989045 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-170ab3b5-551e-467e-8334-46a09cc750f4 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] 10.222.0.16 "GET /compute/v2.1/servers/7e8be244-f6d6-40d1-9dba-6e0b134311ff" status: 200 len: 1264 microversion: 2.1 time: 0.167302 Oct 31 19:27:03.989713 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 413/825] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:27:03 2022] GET /compute/v2.1/servers/7e8be244-f6d6-40d1-9dba-6e0b134311ff => generated 1264 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:27:04.017561 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [req-65c7489b-43a2-4846-9a19-c1f0076c5149 req-11f9bb92-ec37-49c2-8511-930f7e3cd9c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e8be244-f6d6-40d1-9dba-6e0b134311ff", "name": "network-vif-plugged", "status": "completed", "tag": "4c57cc47-4bb3-47b7-af6b-73c6816c7ed6"}]} {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:27:04.027983 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [req-65c7489b-43a2-4846-9a19-c1f0076c5149 req-11f9bb92-ec37-49c2-8511-930f7e3cd9c0 service nova] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:27:04.028461 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [req-65c7489b-43a2-4846-9a19-c1f0076c5149 req-11f9bb92-ec37-49c2-8511-930f7e3cd9c0 service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:27:04.029500 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [req-65c7489b-43a2-4846-9a19-c1f0076c5149 req-11f9bb92-ec37-49c2-8511-930f7e3cd9c0 service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:27:04.041389 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.compute.server_external_events [req-65c7489b-43a2-4846-9a19-c1f0076c5149 req-11f9bb92-ec37-49c2-8511-930f7e3cd9c0 service nova] Creating event network-vif-plugged:4c57cc47-4bb3-47b7-af6b-73c6816c7ed6 for instance 7e8be244-f6d6-40d1-9dba-6e0b134311ff on hv-cinder-86309 Oct 31 19:27:04.046237 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [req-65c7489b-43a2-4846-9a19-c1f0076c5149 req-11f9bb92-ec37-49c2-8511-930f7e3cd9c0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032580 Oct 31 19:27:04.046818 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 413/826] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 31 19:27:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:27:04.406762 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-048a7c5a-cff4-4288-bc56-7e8711c82bf8 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:27:04.407367 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-048a7c5a-cff4-4288-bc56-7e8711c82bf8 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:27:04.413226 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-048a7c5a-cff4-4288-bc56-7e8711c82bf8 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:27:04.413734 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-048a7c5a-cff4-4288-bc56-7e8711c82bf8 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:27:04.414165 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-048a7c5a-cff4-4288-bc56-7e8711c82bf8 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:27:04.414850 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-048a7c5a-cff4-4288-bc56-7e8711c82bf8 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:27:04.415298 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-048a7c5a-cff4-4288-bc56-7e8711c82bf8 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:27:04.415979 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-048a7c5a-cff4-4288-bc56-7e8711c82bf8 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:27:04.543107 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-048a7c5a-cff4-4288-bc56-7e8711c82bf8 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:27:04.551045 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-048a7c5a-cff4-4288-bc56-7e8711c82bf8 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:27:04.552481 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-048a7c5a-cff4-4288-bc56-7e8711c82bf8 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:27:04.553665 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-048a7c5a-cff4-4288-bc56-7e8711c82bf8 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29" status: 200 len: 1723 microversion: 2.20 time: 0.150860 Oct 31 19:27:04.554232 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 414/827] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 31 19:27:04 2022] GET /compute/v2.1/servers/3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 19:27:05.012954 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-cba3ac4e-6c32-4ecc-854b-94487ed42929 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:27:05.013548 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-cba3ac4e-6c32-4ecc-854b-94487ed42929 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] [instance: 7e8be244-f6d6-40d1-9dba-6e0b134311ff] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:27:05.019628 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-cba3ac4e-6c32-4ecc-854b-94487ed42929 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:27:05.020111 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-cba3ac4e-6c32-4ecc-854b-94487ed42929 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:27:05.020542 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-cba3ac4e-6c32-4ecc-854b-94487ed42929 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:27:05.021254 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-cba3ac4e-6c32-4ecc-854b-94487ed42929 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:27:05.022524 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-cba3ac4e-6c32-4ecc-854b-94487ed42929 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:27:05.022978 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-cba3ac4e-6c32-4ecc-854b-94487ed42929 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:27:05.152279 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-cba3ac4e-6c32-4ecc-854b-94487ed42929 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e73a60801b04fc7acc4260297fdd2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808cc3e5392b4bb7a80b154a60f69ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:27:05.159814 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-cba3ac4e-6c32-4ecc-854b-94487ed42929 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] 10.222.0.16 "GET /compute/v2.1/servers/7e8be244-f6d6-40d1-9dba-6e0b134311ff" status: 200 len: 1264 microversion: 2.1 time: 0.151598 Oct 31 19:27:05.160368 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 414/828] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:27:05 2022] GET /compute/v2.1/servers/7e8be244-f6d6-40d1-9dba-6e0b134311ff => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:27:05.579024 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-8628ab87-4f50-4aca-acc2-6a8151d36191 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:27:05.579637 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-8628ab87-4f50-4aca-acc2-6a8151d36191 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:27:05.586011 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-8628ab87-4f50-4aca-acc2-6a8151d36191 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:27:05.586487 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-8628ab87-4f50-4aca-acc2-6a8151d36191 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:27:05.586917 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-8628ab87-4f50-4aca-acc2-6a8151d36191 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:27:05.587599 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-8628ab87-4f50-4aca-acc2-6a8151d36191 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:27:05.588048 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-8628ab87-4f50-4aca-acc2-6a8151d36191 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:27:05.588474 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-8628ab87-4f50-4aca-acc2-6a8151d36191 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:27:05.716210 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-8628ab87-4f50-4aca-acc2-6a8151d36191 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:27:05.725173 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-8628ab87-4f50-4aca-acc2-6a8151d36191 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:27:05.726681 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-8628ab87-4f50-4aca-acc2-6a8151d36191 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:27:05.727836 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-8628ab87-4f50-4aca-acc2-6a8151d36191 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29" status: 200 len: 1723 microversion: 2.20 time: 0.152675 Oct 31 19:27:05.728401 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 415/829] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 31 19:27:05 2022] GET /compute/v2.1/servers/3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 19:27:06.182917 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-dd55a6f2-50c2-4365-8d28-577caf4d6c2c tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:27:06.183556 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-dd55a6f2-50c2-4365-8d28-577caf4d6c2c tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] [instance: 7e8be244-f6d6-40d1-9dba-6e0b134311ff] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:27:06.190047 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-dd55a6f2-50c2-4365-8d28-577caf4d6c2c tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:27:06.190524 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-dd55a6f2-50c2-4365-8d28-577caf4d6c2c tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:27:06.190953 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-dd55a6f2-50c2-4365-8d28-577caf4d6c2c tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:27:06.191632 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-dd55a6f2-50c2-4365-8d28-577caf4d6c2c tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:27:06.192082 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-dd55a6f2-50c2-4365-8d28-577caf4d6c2c tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:27:06.192500 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-dd55a6f2-50c2-4365-8d28-577caf4d6c2c tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:27:06.322634 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-dd55a6f2-50c2-4365-8d28-577caf4d6c2c tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e73a60801b04fc7acc4260297fdd2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808cc3e5392b4bb7a80b154a60f69ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:27:06.330582 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-dd55a6f2-50c2-4365-8d28-577caf4d6c2c tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] 10.222.0.16 "GET /compute/v2.1/servers/7e8be244-f6d6-40d1-9dba-6e0b134311ff" status: 200 len: 1264 microversion: 2.1 time: 0.151500 Oct 31 19:27:06.331143 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 415/830] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:27:06 2022] GET /compute/v2.1/servers/7e8be244-f6d6-40d1-9dba-6e0b134311ff => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:27:06.753477 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-5b6c84ae-7003-4528-9b1f-cecaff061f3b tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:27:06.754653 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-5b6c84ae-7003-4528-9b1f-cecaff061f3b tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:27:06.761110 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-5b6c84ae-7003-4528-9b1f-cecaff061f3b tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:27:06.761590 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-5b6c84ae-7003-4528-9b1f-cecaff061f3b tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:27:06.762048 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-5b6c84ae-7003-4528-9b1f-cecaff061f3b tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:27:06.762730 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-5b6c84ae-7003-4528-9b1f-cecaff061f3b tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:27:06.763185 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-5b6c84ae-7003-4528-9b1f-cecaff061f3b tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:27:06.763608 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-5b6c84ae-7003-4528-9b1f-cecaff061f3b tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:27:06.893666 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-5b6c84ae-7003-4528-9b1f-cecaff061f3b tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:27:06.902128 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-5b6c84ae-7003-4528-9b1f-cecaff061f3b tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:27:06.903566 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-5b6c84ae-7003-4528-9b1f-cecaff061f3b tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:27:06.904710 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-5b6c84ae-7003-4528-9b1f-cecaff061f3b tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29" status: 200 len: 1723 microversion: 2.20 time: 0.155135 Oct 31 19:27:06.905265 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 416/831] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 31 19:27:06 2022] GET /compute/v2.1/servers/3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 19:27:07.354026 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-a49961ad-04a9-44c9-94ad-f07be20ada9e tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:27:07.354667 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-a49961ad-04a9-44c9-94ad-f07be20ada9e tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] [instance: 7e8be244-f6d6-40d1-9dba-6e0b134311ff] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:27:07.361083 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-a49961ad-04a9-44c9-94ad-f07be20ada9e tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:27:07.361564 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-a49961ad-04a9-44c9-94ad-f07be20ada9e tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:27:07.362027 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-a49961ad-04a9-44c9-94ad-f07be20ada9e tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:27:07.362739 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-a49961ad-04a9-44c9-94ad-f07be20ada9e tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:27:07.363195 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-a49961ad-04a9-44c9-94ad-f07be20ada9e tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:27:07.363618 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-a49961ad-04a9-44c9-94ad-f07be20ada9e tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:27:07.489135 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-a49961ad-04a9-44c9-94ad-f07be20ada9e tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e73a60801b04fc7acc4260297fdd2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808cc3e5392b4bb7a80b154a60f69ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:27:07.497434 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-a49961ad-04a9-44c9-94ad-f07be20ada9e tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] 10.222.0.16 "GET /compute/v2.1/servers/7e8be244-f6d6-40d1-9dba-6e0b134311ff" status: 200 len: 1264 microversion: 2.1 time: 0.147410 Oct 31 19:27:07.498039 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 416/832] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:27:07 2022] GET /compute/v2.1/servers/7e8be244-f6d6-40d1-9dba-6e0b134311ff => generated 1264 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:27:07.930702 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-3691ce5c-9ec5-4e5c-beb2-fcc13514a514 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:27:07.931301 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-3691ce5c-9ec5-4e5c-beb2-fcc13514a514 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:27:07.938396 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-3691ce5c-9ec5-4e5c-beb2-fcc13514a514 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:27:07.940291 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-3691ce5c-9ec5-4e5c-beb2-fcc13514a514 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:27:07.940967 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-3691ce5c-9ec5-4e5c-beb2-fcc13514a514 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:27:07.942737 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-3691ce5c-9ec5-4e5c-beb2-fcc13514a514 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:27:07.943707 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-3691ce5c-9ec5-4e5c-beb2-fcc13514a514 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:27:07.944386 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-3691ce5c-9ec5-4e5c-beb2-fcc13514a514 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:27:07.949679 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG dbcounter [-] [118727] Writing DB stats nova_cell1:SELECT=100 {{(pid=118727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:27:07.973008 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [req-399149a6-92ad-4572-b94c-00036c8d657e req-a1583cea-2b36-43ce-ad33-0f3b2e8e97dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29", "name": "network-vif-unplugged", "status": "completed", "tag": "0e51264f-300d-49b6-9f03-c22ed061b801"}]} {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:27:07.985027 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [req-399149a6-92ad-4572-b94c-00036c8d657e req-a1583cea-2b36-43ce-ad33-0f3b2e8e97dd service nova] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:27:07.985907 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [req-399149a6-92ad-4572-b94c-00036c8d657e req-a1583cea-2b36-43ce-ad33-0f3b2e8e97dd service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:27:07.986347 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [req-399149a6-92ad-4572-b94c-00036c8d657e req-a1583cea-2b36-43ce-ad33-0f3b2e8e97dd service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:27:07.998347 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.compute.server_external_events [req-399149a6-92ad-4572-b94c-00036c8d657e req-a1583cea-2b36-43ce-ad33-0f3b2e8e97dd service nova] Creating event network-vif-unplugged:0e51264f-300d-49b6-9f03-c22ed061b801 for instance 3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29 on hv-cinder-86309 Oct 31 19:27:08.003383 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [req-399149a6-92ad-4572-b94c-00036c8d657e req-a1583cea-2b36-43ce-ad33-0f3b2e8e97dd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034975 Oct 31 19:27:08.004717 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 417/833] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 31 19:27:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 19:27:08.121349 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-3691ce5c-9ec5-4e5c-beb2-fcc13514a514 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:27:08.130067 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-3691ce5c-9ec5-4e5c-beb2-fcc13514a514 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:27:08.131521 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-3691ce5c-9ec5-4e5c-beb2-fcc13514a514 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:27:08.132680 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-3691ce5c-9ec5-4e5c-beb2-fcc13514a514 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29" status: 200 len: 1723 microversion: 2.20 time: 0.205973 Oct 31 19:27:08.133244 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 417/834] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 31 19:27:07 2022] GET /compute/v2.1/servers/3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29 => generated 1723 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 19:27:08.522400 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-aff76ada-c3de-4807-8580-7b9fc21ac2af tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:27:08.523111 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-aff76ada-c3de-4807-8580-7b9fc21ac2af tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] [instance: 7e8be244-f6d6-40d1-9dba-6e0b134311ff] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:27:08.529085 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-aff76ada-c3de-4807-8580-7b9fc21ac2af tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:27:08.529567 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-aff76ada-c3de-4807-8580-7b9fc21ac2af tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:27:08.530036 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-aff76ada-c3de-4807-8580-7b9fc21ac2af tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:27:08.530731 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-aff76ada-c3de-4807-8580-7b9fc21ac2af tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:27:08.531188 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-aff76ada-c3de-4807-8580-7b9fc21ac2af tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:27:08.531614 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-aff76ada-c3de-4807-8580-7b9fc21ac2af tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:27:08.670192 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-aff76ada-c3de-4807-8580-7b9fc21ac2af tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e73a60801b04fc7acc4260297fdd2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808cc3e5392b4bb7a80b154a60f69ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:27:08.677904 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-aff76ada-c3de-4807-8580-7b9fc21ac2af tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] 10.222.0.16 "GET /compute/v2.1/servers/7e8be244-f6d6-40d1-9dba-6e0b134311ff" status: 200 len: 1264 microversion: 2.1 time: 0.160883 Oct 31 19:27:08.678464 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 418/835] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:27:08 2022] GET /compute/v2.1/servers/7e8be244-f6d6-40d1-9dba-6e0b134311ff => generated 1264 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:27:09.157782 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-49153dcf-44c8-4ba2-803f-813dde144072 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:27:09.158389 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-49153dcf-44c8-4ba2-803f-813dde144072 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:27:09.165369 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-49153dcf-44c8-4ba2-803f-813dde144072 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:27:09.166162 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-49153dcf-44c8-4ba2-803f-813dde144072 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:27:09.166559 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-49153dcf-44c8-4ba2-803f-813dde144072 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:27:09.167432 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-49153dcf-44c8-4ba2-803f-813dde144072 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:27:09.167928 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-49153dcf-44c8-4ba2-803f-813dde144072 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:27:09.168373 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-49153dcf-44c8-4ba2-803f-813dde144072 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:27:09.237041 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-e6a7724d-2059-485c-89f3-b14184f30c44 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:27:09.237983 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-e6a7724d-2059-485c-89f3-b14184f30c44 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] [instance: c96bdeca-16e0-4d90-a9f9-0f9d46799d68] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:27:09.244723 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-e6a7724d-2059-485c-89f3-b14184f30c44 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:27:09.245297 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-e6a7724d-2059-485c-89f3-b14184f30c44 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:27:09.245845 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-e6a7724d-2059-485c-89f3-b14184f30c44 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:27:09.246971 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-e6a7724d-2059-485c-89f3-b14184f30c44 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:27:09.247523 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-e6a7724d-2059-485c-89f3-b14184f30c44 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:27:09.248014 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-e6a7724d-2059-485c-89f3-b14184f30c44 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:27:09.277012 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-e6a7724d-2059-485c-89f3-b14184f30c44 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] 10.222.0.16 "GET /compute/v2.1/servers/c96bdeca-16e0-4d90-a9f9-0f9d46799d68/ips" status: 200 len: 144 microversion: 2.1 time: 0.044866 Oct 31 19:27:09.278200 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 419/836] 10.222.0.16 () {58 vars in 1248 bytes} [Mon Oct 31 19:27:09 2022] GET /compute/v2.1/servers/c96bdeca-16e0-4d90-a9f9-0f9d46799d68/ips => generated 144 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:27:09.337920 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-49153dcf-44c8-4ba2-803f-813dde144072 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:27:09.337920 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-49153dcf-44c8-4ba2-803f-813dde144072 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:27:09.339231 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-49153dcf-44c8-4ba2-803f-813dde144072 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:27:09.340458 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-49153dcf-44c8-4ba2-803f-813dde144072 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29" status: 200 len: 1666 microversion: 2.20 time: 0.186437 Oct 31 19:27:09.341195 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 418/837] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 31 19:27:09 2022] GET /compute/v2.1/servers/3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29 => generated 1666 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 19:27:09.365097 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-0d6d5c3d-2b2e-4d94-ae96-c87022a3df53 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "381f500d-d74a-4262-bf38-f635fbb40fee"}} {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:27:09.367450 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-0d6d5c3d-2b2e-4d94-ae96-c87022a3df53 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:27:09.373472 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-0d6d5c3d-2b2e-4d94-ae96-c87022a3df53 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:27:09.373978 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-0d6d5c3d-2b2e-4d94-ae96-c87022a3df53 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:27:09.374411 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-0d6d5c3d-2b2e-4d94-ae96-c87022a3df53 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:27:09.375096 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-0d6d5c3d-2b2e-4d94-ae96-c87022a3df53 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:27:09.375547 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-0d6d5c3d-2b2e-4d94-ae96-c87022a3df53 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:27:09.375961 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-0d6d5c3d-2b2e-4d94-ae96-c87022a3df53 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:27:09.700820 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-f2cad905-9489-478d-9bf0-667ed498cd1e tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:27:09.701867 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-f2cad905-9489-478d-9bf0-667ed498cd1e tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] [instance: 7e8be244-f6d6-40d1-9dba-6e0b134311ff] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:27:09.708862 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-f2cad905-9489-478d-9bf0-667ed498cd1e tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:27:09.709349 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-f2cad905-9489-478d-9bf0-667ed498cd1e tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:27:09.709871 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-f2cad905-9489-478d-9bf0-667ed498cd1e tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:27:09.710553 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-f2cad905-9489-478d-9bf0-667ed498cd1e tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:27:09.711410 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-f2cad905-9489-478d-9bf0-667ed498cd1e tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:27:09.712300 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-f2cad905-9489-478d-9bf0-667ed498cd1e tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:27:09.758963 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-0d6d5c3d-2b2e-4d94-ae96-c87022a3df53 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "POST /compute/v2.1/servers/3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.397756 Oct 31 19:27:09.759573 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 420/838] 10.222.0.16 () {62 vars in 1364 bytes} [Mon Oct 31 19:27:09 2022] POST /compute/v2.1/servers/3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29/os-volume_attachments => generated 188 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 19:27:09.849197 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-f2cad905-9489-478d-9bf0-667ed498cd1e tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e73a60801b04fc7acc4260297fdd2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808cc3e5392b4bb7a80b154a60f69ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:27:09.856891 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-f2cad905-9489-478d-9bf0-667ed498cd1e tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] 10.222.0.16 "GET /compute/v2.1/servers/7e8be244-f6d6-40d1-9dba-6e0b134311ff" status: 200 len: 1451 microversion: 2.1 time: 0.160064 Oct 31 19:27:09.857534 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 419/839] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:27:09 2022] GET /compute/v2.1/servers/7e8be244-f6d6-40d1-9dba-6e0b134311ff => generated 1451 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 19:27:09.879687 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-89de45b1-5b66-4ba3-b216-79a7bab3780f tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:27:09.880298 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-89de45b1-5b66-4ba3-b216-79a7bab3780f tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] [instance: 7e8be244-f6d6-40d1-9dba-6e0b134311ff] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:27:09.886405 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-89de45b1-5b66-4ba3-b216-79a7bab3780f tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:27:09.886877 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-89de45b1-5b66-4ba3-b216-79a7bab3780f tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:27:09.887304 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-89de45b1-5b66-4ba3-b216-79a7bab3780f tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:27:09.887979 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-89de45b1-5b66-4ba3-b216-79a7bab3780f tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:27:09.888424 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-89de45b1-5b66-4ba3-b216-79a7bab3780f tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:27:09.888844 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-89de45b1-5b66-4ba3-b216-79a7bab3780f tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:27:09.895830 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-521f3658-7c24-4016-ac8a-b159b05d077c tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:27:09.896338 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-521f3658-7c24-4016-ac8a-b159b05d077c tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:27:09.902228 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-521f3658-7c24-4016-ac8a-b159b05d077c tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:27:09.902758 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-521f3658-7c24-4016-ac8a-b159b05d077c tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:27:09.903292 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-521f3658-7c24-4016-ac8a-b159b05d077c tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:27:09.904000 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-521f3658-7c24-4016-ac8a-b159b05d077c tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:27:09.904457 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-521f3658-7c24-4016-ac8a-b159b05d077c tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:27:09.904882 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-521f3658-7c24-4016-ac8a-b159b05d077c tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:27:10.022397 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-89de45b1-5b66-4ba3-b216-79a7bab3780f tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e73a60801b04fc7acc4260297fdd2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808cc3e5392b4bb7a80b154a60f69ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:27:10.030307 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-89de45b1-5b66-4ba3-b216-79a7bab3780f tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] 10.222.0.16 "GET /compute/v2.1/servers/7e8be244-f6d6-40d1-9dba-6e0b134311ff" status: 200 len: 1451 microversion: 2.1 time: 0.154993 Oct 31 19:27:10.030866 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 421/840] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:27:09 2022] GET /compute/v2.1/servers/7e8be244-f6d6-40d1-9dba-6e0b134311ff => generated 1451 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:27:10.194263 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-521f3658-7c24-4016-ac8a-b159b05d077c tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "DELETE /compute/v2.1/servers/3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29/os-volume_attachments/381f500d-d74a-4262-bf38-f635fbb40fee" status: 202 len: 0 microversion: 2.20 time: 0.302363 Oct 31 19:27:10.194944 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 420/841] 10.222.0.16 () {60 vars in 1457 bytes} [Mon Oct 31 19:27:09 2022] DELETE /compute/v2.1/servers/3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29/os-volume_attachments/381f500d-d74a-4262-bf38-f635fbb40fee => generated 0 bytes in 304 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 31 19:27:10.256198 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-b17c2ce7-edf7-42b6-ab79-dc40c29bff65 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:27:10.256785 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-b17c2ce7-edf7-42b6-ab79-dc40c29bff65 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:27:10.262647 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-b17c2ce7-edf7-42b6-ab79-dc40c29bff65 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:27:10.263121 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-b17c2ce7-edf7-42b6-ab79-dc40c29bff65 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:27:10.263555 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-b17c2ce7-edf7-42b6-ab79-dc40c29bff65 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:27:10.264232 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-b17c2ce7-edf7-42b6-ab79-dc40c29bff65 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:27:10.264679 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-b17c2ce7-edf7-42b6-ab79-dc40c29bff65 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:27:10.265097 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-b17c2ce7-edf7-42b6-ab79-dc40c29bff65 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:27:10.294958 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-b17c2ce7-edf7-42b6-ab79-dc40c29bff65 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=118726) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 31 19:27:10.365455 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-b17c2ce7-edf7-42b6-ab79-dc40c29bff65 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "POST /compute/v2.1/servers/3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29/action" status: 202 len: 0 microversion: 2.20 time: 0.113161 Oct 31 19:27:10.366374 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 422/842] 10.222.0.16 () {62 vars in 1319 bytes} [Mon Oct 31 19:27:10 2022] POST /compute/v2.1/servers/3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 31 19:27:10.374254 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-09136d23-a3f8-4022-8876-1fc463855bfa tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:27:10.374968 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-09136d23-a3f8-4022-8876-1fc463855bfa tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:27:10.383960 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-09136d23-a3f8-4022-8876-1fc463855bfa tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:27:10.384528 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-09136d23-a3f8-4022-8876-1fc463855bfa tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:27:10.385179 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-09136d23-a3f8-4022-8876-1fc463855bfa tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:27:10.386133 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-09136d23-a3f8-4022-8876-1fc463855bfa tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:27:10.386683 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-09136d23-a3f8-4022-8876-1fc463855bfa tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:27:10.387161 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-09136d23-a3f8-4022-8876-1fc463855bfa tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:27:10.532523 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-09136d23-a3f8-4022-8876-1fc463855bfa tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:27:10.541650 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-09136d23-a3f8-4022-8876-1fc463855bfa tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:27:10.543515 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-09136d23-a3f8-4022-8876-1fc463855bfa tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:27:10.545153 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-09136d23-a3f8-4022-8876-1fc463855bfa tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29" status: 200 len: 1674 microversion: 2.20 time: 0.174339 Oct 31 19:27:10.545927 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 421/843] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 31 19:27:10 2022] GET /compute/v2.1/servers/3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29 => generated 1674 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 19:27:10.672961 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-bde514d4-efbd-47d8-be79-036cb8a1f2c7 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c39cf2b8-2e4b-4d62-aa48-0cdc30278442"}} {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:27:10.675409 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-bde514d4-efbd-47d8-be79-036cb8a1f2c7 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] [instance: c96bdeca-16e0-4d90-a9f9-0f9d46799d68] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:27:10.683174 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-bde514d4-efbd-47d8-be79-036cb8a1f2c7 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:27:10.683619 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-bde514d4-efbd-47d8-be79-036cb8a1f2c7 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:27:10.684062 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-bde514d4-efbd-47d8-be79-036cb8a1f2c7 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:27:10.684771 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-bde514d4-efbd-47d8-be79-036cb8a1f2c7 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:27:10.685234 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-bde514d4-efbd-47d8-be79-036cb8a1f2c7 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:27:10.685685 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-bde514d4-efbd-47d8-be79-036cb8a1f2c7 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:27:10.979216 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG dbcounter [-] [118726] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=4,nova_cell1:UPDATE=7 {{(pid=118726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:27:10.992482 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-bde514d4-efbd-47d8-be79-036cb8a1f2c7 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] 10.222.0.16 "POST /compute/v2.1/servers/c96bdeca-16e0-4d90-a9f9-0f9d46799d68/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.323689 Oct 31 19:27:10.993092 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 423/844] 10.222.0.16 () {60 vars in 1323 bytes} [Mon Oct 31 19:27:10 2022] POST /compute/v2.1/servers/c96bdeca-16e0-4d90-a9f9-0f9d46799d68/os-volume_attachments => generated 194 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:27:11.571465 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-ceac9053-a24d-40fc-8a18-c1b301fbdb63 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:27:11.572079 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-ceac9053-a24d-40fc-8a18-c1b301fbdb63 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:27:11.578461 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-ceac9053-a24d-40fc-8a18-c1b301fbdb63 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:27:11.578943 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-ceac9053-a24d-40fc-8a18-c1b301fbdb63 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:27:11.579377 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-ceac9053-a24d-40fc-8a18-c1b301fbdb63 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:27:11.580066 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-ceac9053-a24d-40fc-8a18-c1b301fbdb63 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:27:11.580517 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-ceac9053-a24d-40fc-8a18-c1b301fbdb63 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:27:11.580934 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-ceac9053-a24d-40fc-8a18-c1b301fbdb63 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:27:11.724734 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-ceac9053-a24d-40fc-8a18-c1b301fbdb63 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:27:11.734147 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-ceac9053-a24d-40fc-8a18-c1b301fbdb63 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:27:11.736285 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-ceac9053-a24d-40fc-8a18-c1b301fbdb63 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:27:11.737486 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-ceac9053-a24d-40fc-8a18-c1b301fbdb63 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29" status: 200 len: 1732 microversion: 2.20 time: 0.169985 Oct 31 19:27:11.738636 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 422/845] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 31 19:27:11 2022] GET /compute/v2.1/servers/3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29 => generated 1732 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 19:27:11.751684 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [req-46e134f2-f539-4908-ab7d-f87e8f99273b req-c1c03bf6-961d-4db1-adf6-ee5fa40eeeec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e8be244-f6d6-40d1-9dba-6e0b134311ff", "tag": "4c57cc47-4bb3-47b7-af6b-73c6816c7ed6"}]} {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:27:11.762228 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [req-46e134f2-f539-4908-ab7d-f87e8f99273b req-c1c03bf6-961d-4db1-adf6-ee5fa40eeeec service nova] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:27:11.762706 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [req-46e134f2-f539-4908-ab7d-f87e8f99273b req-c1c03bf6-961d-4db1-adf6-ee5fa40eeeec service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:27:11.763133 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [req-46e134f2-f539-4908-ab7d-f87e8f99273b req-c1c03bf6-961d-4db1-adf6-ee5fa40eeeec service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:27:11.776226 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.compute.server_external_events [req-46e134f2-f539-4908-ab7d-f87e8f99273b req-c1c03bf6-961d-4db1-adf6-ee5fa40eeeec service nova] Creating event network-changed:4c57cc47-4bb3-47b7-af6b-73c6816c7ed6 for instance 7e8be244-f6d6-40d1-9dba-6e0b134311ff on hv-cinder-86309 Oct 31 19:27:11.781580 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [req-46e134f2-f539-4908-ab7d-f87e8f99273b req-c1c03bf6-961d-4db1-adf6-ee5fa40eeeec service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034924 Oct 31 19:27:11.782768 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 424/846] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 31 19:27:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:27:12.765482 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-0b9b7aee-b1ee-4ac5-9896-9fea436ed343 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:27:12.766209 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-0b9b7aee-b1ee-4ac5-9896-9fea436ed343 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:27:12.776176 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-0b9b7aee-b1ee-4ac5-9896-9fea436ed343 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:27:12.776670 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-0b9b7aee-b1ee-4ac5-9896-9fea436ed343 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:27:12.777305 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-0b9b7aee-b1ee-4ac5-9896-9fea436ed343 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:27:12.778326 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-0b9b7aee-b1ee-4ac5-9896-9fea436ed343 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:27:12.778952 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-0b9b7aee-b1ee-4ac5-9896-9fea436ed343 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:27:12.779379 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-0b9b7aee-b1ee-4ac5-9896-9fea436ed343 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:27:12.924530 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-0b9b7aee-b1ee-4ac5-9896-9fea436ed343 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:27:12.932785 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-0b9b7aee-b1ee-4ac5-9896-9fea436ed343 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:27:12.934267 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-0b9b7aee-b1ee-4ac5-9896-9fea436ed343 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:27:12.935422 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-0b9b7aee-b1ee-4ac5-9896-9fea436ed343 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29" status: 200 len: 1732 microversion: 2.20 time: 0.175100 Oct 31 19:27:12.935983 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 423/847] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 31 19:27:12 2022] GET /compute/v2.1/servers/3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29 => generated 1732 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 19:27:13.962958 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-9708271d-5dca-4591-a573-ff26a2cae70f tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:27:13.964424 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-9708271d-5dca-4591-a573-ff26a2cae70f tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:27:13.966608 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG dbcounter [-] [118726] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=118726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:27:13.973247 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-9708271d-5dca-4591-a573-ff26a2cae70f tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:27:13.973800 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-9708271d-5dca-4591-a573-ff26a2cae70f tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:27:13.974264 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-9708271d-5dca-4591-a573-ff26a2cae70f tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:27:13.974963 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-9708271d-5dca-4591-a573-ff26a2cae70f tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:27:13.975418 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-9708271d-5dca-4591-a573-ff26a2cae70f tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:27:13.975841 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-9708271d-5dca-4591-a573-ff26a2cae70f tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:27:14.427417 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-9708271d-5dca-4591-a573-ff26a2cae70f tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:27:14.438127 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-9708271d-5dca-4591-a573-ff26a2cae70f tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:27:14.440307 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-9708271d-5dca-4591-a573-ff26a2cae70f tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:27:14.442296 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-9708271d-5dca-4591-a573-ff26a2cae70f tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29" status: 200 len: 1732 microversion: 2.20 time: 0.483990 Oct 31 19:27:14.449936 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 425/848] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 31 19:27:13 2022] GET /compute/v2.1/servers/3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29 => generated 1732 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 19:27:15.478675 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-6cea3c4a-1301-4394-a02c-68ffb77eb60d tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:27:15.479295 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-6cea3c4a-1301-4394-a02c-68ffb77eb60d tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:27:15.486792 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-6cea3c4a-1301-4394-a02c-68ffb77eb60d tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:27:15.487741 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-6cea3c4a-1301-4394-a02c-68ffb77eb60d tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:27:15.487876 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-6cea3c4a-1301-4394-a02c-68ffb77eb60d tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:27:15.488703 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-6cea3c4a-1301-4394-a02c-68ffb77eb60d tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:27:15.489227 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-6cea3c4a-1301-4394-a02c-68ffb77eb60d tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:27:15.489759 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-6cea3c4a-1301-4394-a02c-68ffb77eb60d tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:27:15.639682 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-6cea3c4a-1301-4394-a02c-68ffb77eb60d tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:27:15.649949 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-6cea3c4a-1301-4394-a02c-68ffb77eb60d tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:27:15.651218 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-6cea3c4a-1301-4394-a02c-68ffb77eb60d tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:27:15.652945 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-6cea3c4a-1301-4394-a02c-68ffb77eb60d tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29" status: 200 len: 1732 microversion: 2.20 time: 0.180269 Oct 31 19:27:15.653883 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 424/849] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 31 19:27:15 2022] GET /compute/v2.1/servers/3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29 => generated 1732 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 19:27:16.680105 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-3d3421ce-b63f-4344-b14a-76348879a2a3 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:27:16.681523 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-3d3421ce-b63f-4344-b14a-76348879a2a3 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:27:16.690912 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-3d3421ce-b63f-4344-b14a-76348879a2a3 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:27:16.691956 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-3d3421ce-b63f-4344-b14a-76348879a2a3 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:27:16.692442 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-3d3421ce-b63f-4344-b14a-76348879a2a3 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:27:16.693166 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-3d3421ce-b63f-4344-b14a-76348879a2a3 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:27:16.693712 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-3d3421ce-b63f-4344-b14a-76348879a2a3 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:27:16.694071 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-3d3421ce-b63f-4344-b14a-76348879a2a3 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:27:16.850931 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-3d3421ce-b63f-4344-b14a-76348879a2a3 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:27:16.860003 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-3d3421ce-b63f-4344-b14a-76348879a2a3 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:27:16.861870 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-3d3421ce-b63f-4344-b14a-76348879a2a3 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:27:16.863291 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-3d3421ce-b63f-4344-b14a-76348879a2a3 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29" status: 200 len: 1732 microversion: 2.20 time: 0.187180 Oct 31 19:27:16.863851 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 426/850] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 31 19:27:16 2022] GET /compute/v2.1/servers/3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29 => generated 1732 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 19:27:17.889863 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-3aa7c809-9295-4f3c-93b3-2f06b540deee tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:27:17.891074 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-3aa7c809-9295-4f3c-93b3-2f06b540deee tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:27:17.898062 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-3aa7c809-9295-4f3c-93b3-2f06b540deee tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:27:17.898552 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-3aa7c809-9295-4f3c-93b3-2f06b540deee tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:27:17.898985 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-3aa7c809-9295-4f3c-93b3-2f06b540deee tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:27:17.899685 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-3aa7c809-9295-4f3c-93b3-2f06b540deee tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:27:17.900301 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-3aa7c809-9295-4f3c-93b3-2f06b540deee tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:27:17.900914 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-3aa7c809-9295-4f3c-93b3-2f06b540deee tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:27:18.037047 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-3aa7c809-9295-4f3c-93b3-2f06b540deee tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:27:18.046113 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-3aa7c809-9295-4f3c-93b3-2f06b540deee tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:27:18.047536 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-3aa7c809-9295-4f3c-93b3-2f06b540deee tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:27:18.048843 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-3aa7c809-9295-4f3c-93b3-2f06b540deee tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29" status: 200 len: 1732 microversion: 2.20 time: 0.163086 Oct 31 19:27:18.049572 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 425/851] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 31 19:27:17 2022] GET /compute/v2.1/servers/3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29 => generated 1732 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 19:27:19.078908 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-5acf2fa3-8684-4cf8-b491-7d6705bcd36f tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:27:19.079629 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-5acf2fa3-8684-4cf8-b491-7d6705bcd36f tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:27:19.086875 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-5acf2fa3-8684-4cf8-b491-7d6705bcd36f tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:27:19.087361 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-5acf2fa3-8684-4cf8-b491-7d6705bcd36f tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:27:19.087799 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-5acf2fa3-8684-4cf8-b491-7d6705bcd36f tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:27:19.088501 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-5acf2fa3-8684-4cf8-b491-7d6705bcd36f tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:27:19.088959 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-5acf2fa3-8684-4cf8-b491-7d6705bcd36f tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:27:19.089387 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-5acf2fa3-8684-4cf8-b491-7d6705bcd36f tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:27:19.226643 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-5acf2fa3-8684-4cf8-b491-7d6705bcd36f tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:27:19.234948 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-5acf2fa3-8684-4cf8-b491-7d6705bcd36f tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:27:19.236405 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-5acf2fa3-8684-4cf8-b491-7d6705bcd36f tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:27:19.237795 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-5acf2fa3-8684-4cf8-b491-7d6705bcd36f tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29" status: 200 len: 1732 microversion: 2.20 time: 0.162879 Oct 31 19:27:19.238489 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 427/852] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 31 19:27:19 2022] GET /compute/v2.1/servers/3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29 => generated 1732 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 19:27:20.263687 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-e5f2e2eb-867c-4879-bf5a-440bbbd97451 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:27:20.264331 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-e5f2e2eb-867c-4879-bf5a-440bbbd97451 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:27:20.270957 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-e5f2e2eb-867c-4879-bf5a-440bbbd97451 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:27:20.271473 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-e5f2e2eb-867c-4879-bf5a-440bbbd97451 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:27:20.271903 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-e5f2e2eb-867c-4879-bf5a-440bbbd97451 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:27:20.272607 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-e5f2e2eb-867c-4879-bf5a-440bbbd97451 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:27:20.273157 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-e5f2e2eb-867c-4879-bf5a-440bbbd97451 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:27:20.273815 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-e5f2e2eb-867c-4879-bf5a-440bbbd97451 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:27:20.413800 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-e5f2e2eb-867c-4879-bf5a-440bbbd97451 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:27:20.424892 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-e5f2e2eb-867c-4879-bf5a-440bbbd97451 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:27:20.427539 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-e5f2e2eb-867c-4879-bf5a-440bbbd97451 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:27:20.428951 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-e5f2e2eb-867c-4879-bf5a-440bbbd97451 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29" status: 200 len: 1732 microversion: 2.20 time: 0.169239 Oct 31 19:27:20.429597 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 426/853] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 31 19:27:20 2022] GET /compute/v2.1/servers/3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29 => generated 1732 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 19:27:21.454744 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-ade3bd36-ccd4-4131-a8e4-aa2fff9caca7 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:27:21.455353 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-ade3bd36-ccd4-4131-a8e4-aa2fff9caca7 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:27:21.462548 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-ade3bd36-ccd4-4131-a8e4-aa2fff9caca7 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:27:21.463025 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-ade3bd36-ccd4-4131-a8e4-aa2fff9caca7 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:27:21.463454 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-ade3bd36-ccd4-4131-a8e4-aa2fff9caca7 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:27:21.464163 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-ade3bd36-ccd4-4131-a8e4-aa2fff9caca7 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:27:21.464597 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-ade3bd36-ccd4-4131-a8e4-aa2fff9caca7 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:27:21.465022 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-ade3bd36-ccd4-4131-a8e4-aa2fff9caca7 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:27:21.594686 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-ade3bd36-ccd4-4131-a8e4-aa2fff9caca7 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:27:21.603247 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-ade3bd36-ccd4-4131-a8e4-aa2fff9caca7 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:27:21.604678 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-ade3bd36-ccd4-4131-a8e4-aa2fff9caca7 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:27:21.605853 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-ade3bd36-ccd4-4131-a8e4-aa2fff9caca7 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29" status: 200 len: 1732 microversion: 2.20 time: 0.154996 Oct 31 19:27:21.606407 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 428/854] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 31 19:27:21 2022] GET /compute/v2.1/servers/3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29 => generated 1732 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 19:27:22.631475 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-754eb9cb-0bb2-4591-9397-22a6eb6f093f tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:27:22.632002 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-754eb9cb-0bb2-4591-9397-22a6eb6f093f tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:27:22.638344 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-754eb9cb-0bb2-4591-9397-22a6eb6f093f tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:27:22.638823 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-754eb9cb-0bb2-4591-9397-22a6eb6f093f tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:27:22.639251 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-754eb9cb-0bb2-4591-9397-22a6eb6f093f tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:27:22.639925 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-754eb9cb-0bb2-4591-9397-22a6eb6f093f tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:27:22.640377 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-754eb9cb-0bb2-4591-9397-22a6eb6f093f tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:27:22.640793 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-754eb9cb-0bb2-4591-9397-22a6eb6f093f tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:27:22.773923 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-754eb9cb-0bb2-4591-9397-22a6eb6f093f tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:27:22.782477 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-754eb9cb-0bb2-4591-9397-22a6eb6f093f tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:27:22.783920 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-754eb9cb-0bb2-4591-9397-22a6eb6f093f tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:27:22.785179 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-754eb9cb-0bb2-4591-9397-22a6eb6f093f tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29" status: 200 len: 1732 microversion: 2.20 time: 0.158202 Oct 31 19:27:22.786887 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 427/855] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 31 19:27:22 2022] GET /compute/v2.1/servers/3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29 => generated 1732 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 19:27:23.812633 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-d8a299d5-970a-444c-8a92-202e42340acd tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:27:23.813234 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-d8a299d5-970a-444c-8a92-202e42340acd tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:27:23.820306 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-d8a299d5-970a-444c-8a92-202e42340acd tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:27:23.820779 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-d8a299d5-970a-444c-8a92-202e42340acd tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:27:23.821231 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-d8a299d5-970a-444c-8a92-202e42340acd tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:27:23.821961 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-d8a299d5-970a-444c-8a92-202e42340acd tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:27:23.822412 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-d8a299d5-970a-444c-8a92-202e42340acd tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:27:23.822833 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-d8a299d5-970a-444c-8a92-202e42340acd tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:27:23.950741 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-d8a299d5-970a-444c-8a92-202e42340acd tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:27:23.959302 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-d8a299d5-970a-444c-8a92-202e42340acd tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:27:23.960745 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-d8a299d5-970a-444c-8a92-202e42340acd tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:27:23.961947 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-d8a299d5-970a-444c-8a92-202e42340acd tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29" status: 200 len: 1732 microversion: 2.20 time: 0.153222 Oct 31 19:27:23.973865 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 429/856] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 31 19:27:23 2022] GET /compute/v2.1/servers/3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29 => generated 1732 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 19:27:24.082740 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-252ec037-05ef-4d23-a5f3-c4689cc14c79 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:27:24.085101 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-252ec037-05ef-4d23-a5f3-c4689cc14c79 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] [instance: c96bdeca-16e0-4d90-a9f9-0f9d46799d68] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:27:24.091853 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-252ec037-05ef-4d23-a5f3-c4689cc14c79 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:27:24.092409 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-252ec037-05ef-4d23-a5f3-c4689cc14c79 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:27:24.092829 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-252ec037-05ef-4d23-a5f3-c4689cc14c79 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:27:24.093557 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-252ec037-05ef-4d23-a5f3-c4689cc14c79 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:27:24.094036 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-252ec037-05ef-4d23-a5f3-c4689cc14c79 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:27:24.094468 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-252ec037-05ef-4d23-a5f3-c4689cc14c79 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:27:24.128740 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-252ec037-05ef-4d23-a5f3-c4689cc14c79 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] 10.222.0.16 "GET /compute/v2.1/servers/c96bdeca-16e0-4d90-a9f9-0f9d46799d68/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049993 Oct 31 19:27:24.130026 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 428/857] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Oct 31 19:27:24 2022] GET /compute/v2.1/servers/c96bdeca-16e0-4d90-a9f9-0f9d46799d68/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:27:24.141200 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-c2dcd4fc-9c3a-4120-aa1e-74cf406051ef tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:27:24.142180 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-c2dcd4fc-9c3a-4120-aa1e-74cf406051ef tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] [instance: c96bdeca-16e0-4d90-a9f9-0f9d46799d68] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:27:24.148360 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-c2dcd4fc-9c3a-4120-aa1e-74cf406051ef tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:27:24.148934 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-c2dcd4fc-9c3a-4120-aa1e-74cf406051ef tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:27:24.149437 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-c2dcd4fc-9c3a-4120-aa1e-74cf406051ef tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:27:24.150232 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-c2dcd4fc-9c3a-4120-aa1e-74cf406051ef tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:27:24.150776 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-c2dcd4fc-9c3a-4120-aa1e-74cf406051ef tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:27:24.151261 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-c2dcd4fc-9c3a-4120-aa1e-74cf406051ef tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:27:24.182621 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-c2dcd4fc-9c3a-4120-aa1e-74cf406051ef tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] 10.222.0.16 "GET /compute/v2.1/servers/c96bdeca-16e0-4d90-a9f9-0f9d46799d68/os-volume_attachments/c39cf2b8-2e4b-4d62-aa48-0cdc30278442" status: 200 len: 194 microversion: 2.1 time: 0.045362 Oct 31 19:27:24.183306 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 430/858] 10.222.0.16 () {58 vars in 1413 bytes} [Mon Oct 31 19:27:24 2022] GET /compute/v2.1/servers/c96bdeca-16e0-4d90-a9f9-0f9d46799d68/os-volume_attachments/c39cf2b8-2e4b-4d62-aa48-0cdc30278442 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 19:27:24.987536 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-fe57fbf7-8e46-4246-9b17-815a4d6232de tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:27:24.988149 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-fe57fbf7-8e46-4246-9b17-815a4d6232de tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:27:24.994624 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-fe57fbf7-8e46-4246-9b17-815a4d6232de tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:27:24.995114 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-fe57fbf7-8e46-4246-9b17-815a4d6232de tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:27:24.995577 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-fe57fbf7-8e46-4246-9b17-815a4d6232de tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:27:24.996322 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-fe57fbf7-8e46-4246-9b17-815a4d6232de tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:27:24.996781 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-fe57fbf7-8e46-4246-9b17-815a4d6232de tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:27:24.997213 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-fe57fbf7-8e46-4246-9b17-815a4d6232de tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:27:25.134022 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-fe57fbf7-8e46-4246-9b17-815a4d6232de tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:27:25.142038 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-fe57fbf7-8e46-4246-9b17-815a4d6232de tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:27:25.143486 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-fe57fbf7-8e46-4246-9b17-815a4d6232de tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:27:25.144634 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-fe57fbf7-8e46-4246-9b17-815a4d6232de tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29" status: 200 len: 1732 microversion: 2.20 time: 0.161109 Oct 31 19:27:25.145896 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 429/859] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 31 19:27:24 2022] GET /compute/v2.1/servers/3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29 => generated 1732 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 19:27:25.538684 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-092385a7-dec8-4a56-a46a-0543714e7a79 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "72e76856-b3ff-46c1-b00d-48d312fe5cbf"}} {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:27:25.541367 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-092385a7-dec8-4a56-a46a-0543714e7a79 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] [instance: c96bdeca-16e0-4d90-a9f9-0f9d46799d68] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:27:25.547718 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-092385a7-dec8-4a56-a46a-0543714e7a79 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:27:25.548196 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-092385a7-dec8-4a56-a46a-0543714e7a79 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:27:25.548628 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-092385a7-dec8-4a56-a46a-0543714e7a79 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:27:25.549308 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-092385a7-dec8-4a56-a46a-0543714e7a79 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:27:25.549791 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-092385a7-dec8-4a56-a46a-0543714e7a79 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:27:25.550209 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-092385a7-dec8-4a56-a46a-0543714e7a79 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:27:25.866580 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-092385a7-dec8-4a56-a46a-0543714e7a79 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] 10.222.0.16 "POST /compute/v2.1/servers/c96bdeca-16e0-4d90-a9f9-0f9d46799d68/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.331609 Oct 31 19:27:25.867239 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 431/860] 10.222.0.16 () {60 vars in 1323 bytes} [Mon Oct 31 19:27:25 2022] POST /compute/v2.1/servers/c96bdeca-16e0-4d90-a9f9-0f9d46799d68/os-volume_attachments => generated 194 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:27:26.103802 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [req-2019a97e-f256-46e2-852c-d06ebee76e9d req-3a7690d8-c5b8-4ff7-8964-9e7265cc8181 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29", "name": "network-vif-plugged", "status": "completed", "tag": "0e51264f-300d-49b6-9f03-c22ed061b801"}]} {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:27:26.115571 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [req-2019a97e-f256-46e2-852c-d06ebee76e9d req-3a7690d8-c5b8-4ff7-8964-9e7265cc8181 service nova] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:27:26.116075 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [req-2019a97e-f256-46e2-852c-d06ebee76e9d req-3a7690d8-c5b8-4ff7-8964-9e7265cc8181 service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:27:26.116677 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [req-2019a97e-f256-46e2-852c-d06ebee76e9d req-3a7690d8-c5b8-4ff7-8964-9e7265cc8181 service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:27:26.127767 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.compute.server_external_events [req-2019a97e-f256-46e2-852c-d06ebee76e9d req-3a7690d8-c5b8-4ff7-8964-9e7265cc8181 service nova] Creating event network-vif-plugged:0e51264f-300d-49b6-9f03-c22ed061b801 for instance 3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29 on hv-cinder-86309 Oct 31 19:27:26.133553 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [req-2019a97e-f256-46e2-852c-d06ebee76e9d req-3a7690d8-c5b8-4ff7-8964-9e7265cc8181 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033401 Oct 31 19:27:26.134449 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 430/861] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 31 19:27:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:27:26.171746 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-c2c62ae0-da10-472a-a35a-3d1938cd4782 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:27:26.172457 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-c2c62ae0-da10-472a-a35a-3d1938cd4782 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:27:26.179175 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-c2c62ae0-da10-472a-a35a-3d1938cd4782 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:27:26.179658 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-c2c62ae0-da10-472a-a35a-3d1938cd4782 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:27:26.180093 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-c2c62ae0-da10-472a-a35a-3d1938cd4782 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:27:26.180785 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-c2c62ae0-da10-472a-a35a-3d1938cd4782 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:27:26.181238 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-c2c62ae0-da10-472a-a35a-3d1938cd4782 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:27:26.181684 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-c2c62ae0-da10-472a-a35a-3d1938cd4782 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:27:26.321430 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-c2c62ae0-da10-472a-a35a-3d1938cd4782 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:27:26.329517 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-c2c62ae0-da10-472a-a35a-3d1938cd4782 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:27:26.331105 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-c2c62ae0-da10-472a-a35a-3d1938cd4782 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:27:26.332806 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-c2c62ae0-da10-472a-a35a-3d1938cd4782 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29" status: 200 len: 1732 microversion: 2.20 time: 0.165241 Oct 31 19:27:26.333492 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 432/862] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 31 19:27:26 2022] GET /compute/v2.1/servers/3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29 => generated 1732 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 19:27:27.359140 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-1a862a7d-2846-42c5-962c-4ad516174c27 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:27:27.359829 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-1a862a7d-2846-42c5-962c-4ad516174c27 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:27:27.366298 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-1a862a7d-2846-42c5-962c-4ad516174c27 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:27:27.366775 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-1a862a7d-2846-42c5-962c-4ad516174c27 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:27:27.367201 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-1a862a7d-2846-42c5-962c-4ad516174c27 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:27:27.367874 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-1a862a7d-2846-42c5-962c-4ad516174c27 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:27:27.368318 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-1a862a7d-2846-42c5-962c-4ad516174c27 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:27:27.368733 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-1a862a7d-2846-42c5-962c-4ad516174c27 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:27:27.499459 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-1a862a7d-2846-42c5-962c-4ad516174c27 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:27:27.503075 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG dbcounter [-] [118727] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=118727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:27:27.509116 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-1a862a7d-2846-42c5-962c-4ad516174c27 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:27:27.510583 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-1a862a7d-2846-42c5-962c-4ad516174c27 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:27:27.511732 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-1a862a7d-2846-42c5-962c-4ad516174c27 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29" status: 200 len: 1732 microversion: 2.20 time: 0.156827 Oct 31 19:27:27.512294 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 431/863] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 31 19:27:27 2022] GET /compute/v2.1/servers/3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29 => generated 1732 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 19:27:28.538068 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-a9a77533-1a64-4cfd-82db-5da3b7ed816f tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:27:28.538599 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-a9a77533-1a64-4cfd-82db-5da3b7ed816f tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:27:28.545264 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-a9a77533-1a64-4cfd-82db-5da3b7ed816f tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:27:28.545781 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-a9a77533-1a64-4cfd-82db-5da3b7ed816f tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:27:28.546228 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-a9a77533-1a64-4cfd-82db-5da3b7ed816f tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:27:28.546914 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-a9a77533-1a64-4cfd-82db-5da3b7ed816f tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:27:28.547370 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-a9a77533-1a64-4cfd-82db-5da3b7ed816f tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:27:28.547798 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-a9a77533-1a64-4cfd-82db-5da3b7ed816f tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:27:28.672611 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-a9a77533-1a64-4cfd-82db-5da3b7ed816f tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:27:28.680571 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-a9a77533-1a64-4cfd-82db-5da3b7ed816f tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:27:28.682045 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-a9a77533-1a64-4cfd-82db-5da3b7ed816f tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:27:28.683190 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-a9a77533-1a64-4cfd-82db-5da3b7ed816f tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29" status: 200 len: 1719 microversion: 2.20 time: 0.149768 Oct 31 19:27:28.683746 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 433/864] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 31 19:27:28 2022] GET /compute/v2.1/servers/3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29 => generated 1719 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 19:27:33.404915 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-ab0e6f26-d97c-4bd1-8a22-6685ad97e8b2 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:27:33.407178 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-ab0e6f26-d97c-4bd1-8a22-6685ad97e8b2 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] [instance: c96bdeca-16e0-4d90-a9f9-0f9d46799d68] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:27:33.409740 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG dbcounter [-] [118727] Writing DB stats nova_api:SELECT=46 {{(pid=118727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:27:33.416208 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-ab0e6f26-d97c-4bd1-8a22-6685ad97e8b2 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:27:33.416687 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-ab0e6f26-d97c-4bd1-8a22-6685ad97e8b2 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:27:33.417141 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-ab0e6f26-d97c-4bd1-8a22-6685ad97e8b2 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:27:33.417854 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-ab0e6f26-d97c-4bd1-8a22-6685ad97e8b2 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:27:33.418308 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-ab0e6f26-d97c-4bd1-8a22-6685ad97e8b2 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:27:33.418728 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-ab0e6f26-d97c-4bd1-8a22-6685ad97e8b2 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:27:33.448529 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-ab0e6f26-d97c-4bd1-8a22-6685ad97e8b2 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] 10.222.0.16 "GET /compute/v2.1/servers/c96bdeca-16e0-4d90-a9f9-0f9d46799d68/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.048305 Oct 31 19:27:33.449087 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 432/865] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Oct 31 19:27:33 2022] GET /compute/v2.1/servers/c96bdeca-16e0-4d90-a9f9-0f9d46799d68/os-volume_attachments => generated 371 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:27:33.594283 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-fe0b1a09-27b2-443a-aef9-f4044856de83 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:27:33.594814 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-fe0b1a09-27b2-443a-aef9-f4044856de83 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] [instance: c96bdeca-16e0-4d90-a9f9-0f9d46799d68] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:27:33.601088 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-fe0b1a09-27b2-443a-aef9-f4044856de83 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:27:33.601563 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-fe0b1a09-27b2-443a-aef9-f4044856de83 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:27:33.602024 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-fe0b1a09-27b2-443a-aef9-f4044856de83 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:27:33.602706 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-fe0b1a09-27b2-443a-aef9-f4044856de83 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:27:33.603157 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-fe0b1a09-27b2-443a-aef9-f4044856de83 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:27:33.603577 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-fe0b1a09-27b2-443a-aef9-f4044856de83 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:27:33.634383 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-fe0b1a09-27b2-443a-aef9-f4044856de83 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] 10.222.0.16 "GET /compute/v2.1/servers/c96bdeca-16e0-4d90-a9f9-0f9d46799d68/os-volume_attachments/c39cf2b8-2e4b-4d62-aa48-0cdc30278442" status: 200 len: 194 microversion: 2.1 time: 0.043994 Oct 31 19:27:33.634961 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 434/866] 10.222.0.16 () {58 vars in 1413 bytes} [Mon Oct 31 19:27:33 2022] GET /compute/v2.1/servers/c96bdeca-16e0-4d90-a9f9-0f9d46799d68/os-volume_attachments/c39cf2b8-2e4b-4d62-aa48-0cdc30278442 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:27:33.645167 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-62901295-603d-48d4-a4a2-33cf686fe0d0 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:27:33.645677 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-62901295-603d-48d4-a4a2-33cf686fe0d0 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] [instance: c96bdeca-16e0-4d90-a9f9-0f9d46799d68] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:27:33.651435 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-62901295-603d-48d4-a4a2-33cf686fe0d0 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:27:33.651911 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-62901295-603d-48d4-a4a2-33cf686fe0d0 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:27:33.652339 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-62901295-603d-48d4-a4a2-33cf686fe0d0 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:27:33.653017 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-62901295-603d-48d4-a4a2-33cf686fe0d0 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:27:33.653465 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-62901295-603d-48d4-a4a2-33cf686fe0d0 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:27:33.653979 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-62901295-603d-48d4-a4a2-33cf686fe0d0 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:27:33.732966 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.objects.instance [None req-62901295-603d-48d4-a4a2-33cf686fe0d0 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lazy-loading 'services' on Instance uuid c96bdeca-16e0-4d90-a9f9-0f9d46799d68 {{(pid=118727) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 19:27:33.805561 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-62901295-603d-48d4-a4a2-33cf686fe0d0 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c96bdeca-16e0-4d90-a9f9-0f9d46799d68/os-volume_attachments/c39cf2b8-2e4b-4d62-aa48-0cdc30278442" status: 202 len: 0 microversion: 2.1 time: 0.164136 Oct 31 19:27:33.806181 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 433/867] 10.222.0.16 () {58 vars in 1416 bytes} [Mon Oct 31 19:27:33 2022] DELETE /compute/v2.1/servers/c96bdeca-16e0-4d90-a9f9-0f9d46799d68/os-volume_attachments/c39cf2b8-2e4b-4d62-aa48-0cdc30278442 => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 19:27:34.936724 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-0136060a-47d8-4a60-a0a9-0de21c7338c4 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:27:34.937239 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-0136060a-47d8-4a60-a0a9-0de21c7338c4 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] [instance: c96bdeca-16e0-4d90-a9f9-0f9d46799d68] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:27:34.943876 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-0136060a-47d8-4a60-a0a9-0de21c7338c4 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:27:34.944358 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-0136060a-47d8-4a60-a0a9-0de21c7338c4 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:27:34.944797 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-0136060a-47d8-4a60-a0a9-0de21c7338c4 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:27:34.945511 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-0136060a-47d8-4a60-a0a9-0de21c7338c4 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:27:34.946009 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-0136060a-47d8-4a60-a0a9-0de21c7338c4 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:27:34.946439 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-0136060a-47d8-4a60-a0a9-0de21c7338c4 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:27:34.975251 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-0136060a-47d8-4a60-a0a9-0de21c7338c4 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] 10.222.0.16 "GET /compute/v2.1/servers/c96bdeca-16e0-4d90-a9f9-0f9d46799d68/os-volume_attachments/72e76856-b3ff-46c1-b00d-48d312fe5cbf" status: 200 len: 194 microversion: 2.1 time: 0.042438 Oct 31 19:27:34.975849 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 435/868] 10.222.0.16 () {58 vars in 1413 bytes} [Mon Oct 31 19:27:34 2022] GET /compute/v2.1/servers/c96bdeca-16e0-4d90-a9f9-0f9d46799d68/os-volume_attachments/72e76856-b3ff-46c1-b00d-48d312fe5cbf => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:27:34.987428 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-23e7293c-7256-4d07-8ab3-0986372eaca4 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:27:34.988038 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-23e7293c-7256-4d07-8ab3-0986372eaca4 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] [instance: c96bdeca-16e0-4d90-a9f9-0f9d46799d68] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:27:34.994810 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-23e7293c-7256-4d07-8ab3-0986372eaca4 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:27:34.995285 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-23e7293c-7256-4d07-8ab3-0986372eaca4 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:27:34.995708 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-23e7293c-7256-4d07-8ab3-0986372eaca4 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:27:34.996409 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-23e7293c-7256-4d07-8ab3-0986372eaca4 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:27:34.996857 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-23e7293c-7256-4d07-8ab3-0986372eaca4 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:27:34.997272 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-23e7293c-7256-4d07-8ab3-0986372eaca4 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:27:35.077450 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.objects.instance [None req-23e7293c-7256-4d07-8ab3-0986372eaca4 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lazy-loading 'services' on Instance uuid c96bdeca-16e0-4d90-a9f9-0f9d46799d68 {{(pid=118727) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 19:27:35.146549 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-23e7293c-7256-4d07-8ab3-0986372eaca4 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c96bdeca-16e0-4d90-a9f9-0f9d46799d68/os-volume_attachments/72e76856-b3ff-46c1-b00d-48d312fe5cbf" status: 202 len: 0 microversion: 2.1 time: 0.163628 Oct 31 19:27:35.147318 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 434/869] 10.222.0.16 () {58 vars in 1416 bytes} [Mon Oct 31 19:27:34 2022] DELETE /compute/v2.1/servers/c96bdeca-16e0-4d90-a9f9-0f9d46799d68/os-volume_attachments/72e76856-b3ff-46c1-b00d-48d312fe5cbf => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 19:27:36.324629 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-716e3be1-dbd7-4a23-8dfb-8a2d5cd18e9e tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:27:36.326903 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-716e3be1-dbd7-4a23-8dfb-8a2d5cd18e9e tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] [instance: c96bdeca-16e0-4d90-a9f9-0f9d46799d68] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:27:36.333306 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-716e3be1-dbd7-4a23-8dfb-8a2d5cd18e9e tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:27:36.333832 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-716e3be1-dbd7-4a23-8dfb-8a2d5cd18e9e tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:27:36.334269 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-716e3be1-dbd7-4a23-8dfb-8a2d5cd18e9e tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:27:36.334957 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-716e3be1-dbd7-4a23-8dfb-8a2d5cd18e9e tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:27:36.335413 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-716e3be1-dbd7-4a23-8dfb-8a2d5cd18e9e tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:27:36.335839 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-716e3be1-dbd7-4a23-8dfb-8a2d5cd18e9e tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:27:36.365596 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-716e3be1-dbd7-4a23-8dfb-8a2d5cd18e9e tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] 10.222.0.16 "GET /compute/v2.1/servers/c96bdeca-16e0-4d90-a9f9-0f9d46799d68/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044836 Oct 31 19:27:36.366180 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 436/870] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Oct 31 19:27:36 2022] GET /compute/v2.1/servers/c96bdeca-16e0-4d90-a9f9-0f9d46799d68/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 19:27:36.481363 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-8a19e1b7-bf6a-40e1-8206-5e5cd7083518 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:27:36.483740 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-8a19e1b7-bf6a-40e1-8206-5e5cd7083518 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] [instance: c96bdeca-16e0-4d90-a9f9-0f9d46799d68] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:27:36.491005 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-8a19e1b7-bf6a-40e1-8206-5e5cd7083518 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:27:36.491483 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-8a19e1b7-bf6a-40e1-8206-5e5cd7083518 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:27:36.491912 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-8a19e1b7-bf6a-40e1-8206-5e5cd7083518 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:27:36.492597 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-8a19e1b7-bf6a-40e1-8206-5e5cd7083518 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:27:36.493042 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-8a19e1b7-bf6a-40e1-8206-5e5cd7083518 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:27:36.493494 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-8a19e1b7-bf6a-40e1-8206-5e5cd7083518 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:27:36.523383 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-8a19e1b7-bf6a-40e1-8206-5e5cd7083518 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] 10.222.0.16 "GET /compute/v2.1/servers/c96bdeca-16e0-4d90-a9f9-0f9d46799d68/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046398 Oct 31 19:27:36.523930 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 435/871] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Oct 31 19:27:36 2022] GET /compute/v2.1/servers/c96bdeca-16e0-4d90-a9f9-0f9d46799d68/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 19:27:36.586125 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-20fd5c97-7cfa-4783-8a70-87ec91f35acc tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:27:36.586701 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-20fd5c97-7cfa-4783-8a70-87ec91f35acc tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] [instance: c96bdeca-16e0-4d90-a9f9-0f9d46799d68] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:27:36.592681 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-20fd5c97-7cfa-4783-8a70-87ec91f35acc tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:27:36.593177 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-20fd5c97-7cfa-4783-8a70-87ec91f35acc tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:27:36.593595 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-20fd5c97-7cfa-4783-8a70-87ec91f35acc tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:27:36.594323 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-20fd5c97-7cfa-4783-8a70-87ec91f35acc tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:27:36.594774 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-20fd5c97-7cfa-4783-8a70-87ec91f35acc tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:27:36.595190 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-20fd5c97-7cfa-4783-8a70-87ec91f35acc tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:27:36.620285 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-20fd5c97-7cfa-4783-8a70-87ec91f35acc tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] [instance: c96bdeca-16e0-4d90-a9f9-0f9d46799d68] Going to try to terminate instance {{(pid=118726) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 19:27:36.699128 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-20fd5c97-7cfa-4783-8a70-87ec91f35acc tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c96bdeca-16e0-4d90-a9f9-0f9d46799d68" status: 204 len: 0 microversion: 2.1 time: 0.116875 Oct 31 19:27:36.700357 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 437/872] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 31 19:27:36 2022] DELETE /compute/v2.1/servers/c96bdeca-16e0-4d90-a9f9-0f9d46799d68 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 19:27:36.708986 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-b5f2671f-1268-4242-9f54-240844932161 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:27:36.709625 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-b5f2671f-1268-4242-9f54-240844932161 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] [instance: c96bdeca-16e0-4d90-a9f9-0f9d46799d68] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:27:36.715490 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-b5f2671f-1268-4242-9f54-240844932161 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:27:36.715951 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-b5f2671f-1268-4242-9f54-240844932161 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:27:36.716422 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-b5f2671f-1268-4242-9f54-240844932161 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:27:36.717104 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-b5f2671f-1268-4242-9f54-240844932161 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:27:36.717556 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-b5f2671f-1268-4242-9f54-240844932161 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:27:36.718019 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-b5f2671f-1268-4242-9f54-240844932161 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:27:36.848580 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-b5f2671f-1268-4242-9f54-240844932161 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ece6ca9374764214bac6263bd691bc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9c317b548b40deb8cb27236d36d674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:27:36.856279 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-b5f2671f-1268-4242-9f54-240844932161 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] 10.222.0.16 "GET /compute/v2.1/servers/c96bdeca-16e0-4d90-a9f9-0f9d46799d68" status: 200 len: 1669 microversion: 2.1 time: 0.151731 Oct 31 19:27:36.856853 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 436/873] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:27:36 2022] GET /compute/v2.1/servers/c96bdeca-16e0-4d90-a9f9-0f9d46799d68 => generated 1669 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:27:37.879850 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-690d75e6-62d9-49c7-87a2-6a4717ad4e98 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:27:37.880545 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-690d75e6-62d9-49c7-87a2-6a4717ad4e98 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] [instance: c96bdeca-16e0-4d90-a9f9-0f9d46799d68] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:27:37.886870 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-690d75e6-62d9-49c7-87a2-6a4717ad4e98 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:27:37.887340 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-690d75e6-62d9-49c7-87a2-6a4717ad4e98 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:27:37.887803 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-690d75e6-62d9-49c7-87a2-6a4717ad4e98 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:27:37.888492 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-690d75e6-62d9-49c7-87a2-6a4717ad4e98 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:27:37.888943 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-690d75e6-62d9-49c7-87a2-6a4717ad4e98 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:27:37.889360 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-690d75e6-62d9-49c7-87a2-6a4717ad4e98 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:27:37.891977 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG dbcounter [-] [118726] Writing DB stats nova_cell1:INSERT=3,nova_cell1:SELECT=94,nova_cell1:UPDATE=3 {{(pid=118726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:27:38.021033 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-690d75e6-62d9-49c7-87a2-6a4717ad4e98 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ece6ca9374764214bac6263bd691bc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9c317b548b40deb8cb27236d36d674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:27:38.028689 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-690d75e6-62d9-49c7-87a2-6a4717ad4e98 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] 10.222.0.16 "GET /compute/v2.1/servers/c96bdeca-16e0-4d90-a9f9-0f9d46799d68" status: 200 len: 1669 microversion: 2.1 time: 0.153208 Oct 31 19:27:38.029261 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 438/874] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:27:37 2022] GET /compute/v2.1/servers/c96bdeca-16e0-4d90-a9f9-0f9d46799d68 => generated 1669 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:27:39.052234 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-44e54e16-1e12-44a4-9e7e-c7be84382a8e tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:27:39.053318 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-44e54e16-1e12-44a4-9e7e-c7be84382a8e tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] [instance: c96bdeca-16e0-4d90-a9f9-0f9d46799d68] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:27:39.059793 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-44e54e16-1e12-44a4-9e7e-c7be84382a8e tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:27:39.060300 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-44e54e16-1e12-44a4-9e7e-c7be84382a8e tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:27:39.060715 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-44e54e16-1e12-44a4-9e7e-c7be84382a8e tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:27:39.061405 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-44e54e16-1e12-44a4-9e7e-c7be84382a8e tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:27:39.061890 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-44e54e16-1e12-44a4-9e7e-c7be84382a8e tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:27:39.062315 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-44e54e16-1e12-44a4-9e7e-c7be84382a8e tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:27:39.148441 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-44e54e16-1e12-44a4-9e7e-c7be84382a8e tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ece6ca9374764214bac6263bd691bc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f9c317b548b40deb8cb27236d36d674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:27:39.156056 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-44e54e16-1e12-44a4-9e7e-c7be84382a8e tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] 10.222.0.16 "GET /compute/v2.1/servers/c96bdeca-16e0-4d90-a9f9-0f9d46799d68" status: 200 len: 1602 microversion: 2.1 time: 0.107608 Oct 31 19:27:39.156840 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 437/875] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:27:39 2022] GET /compute/v2.1/servers/c96bdeca-16e0-4d90-a9f9-0f9d46799d68 => generated 1602 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:27:39.337049 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [req-35a96263-da39-4b80-8a9f-420b1a1787e9 req-e9af3ac5-2d59-4d2a-8fb2-3c5e44f490d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c96bdeca-16e0-4d90-a9f9-0f9d46799d68", "name": "network-vif-deleted", "tag": "6abee1f4-a65e-4f4f-9235-4bfd378d8389"}]} {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:27:39.350825 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [req-35a96263-da39-4b80-8a9f-420b1a1787e9 req-e9af3ac5-2d59-4d2a-8fb2-3c5e44f490d8 service nova] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:27:39.351462 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [req-35a96263-da39-4b80-8a9f-420b1a1787e9 req-e9af3ac5-2d59-4d2a-8fb2-3c5e44f490d8 service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:27:39.351995 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [req-35a96263-da39-4b80-8a9f-420b1a1787e9 req-e9af3ac5-2d59-4d2a-8fb2-3c5e44f490d8 service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:27:39.372355 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.compute.server_external_events [req-35a96263-da39-4b80-8a9f-420b1a1787e9 req-e9af3ac5-2d59-4d2a-8fb2-3c5e44f490d8 service nova] Creating event network-vif-deleted:6abee1f4-a65e-4f4f-9235-4bfd378d8389 for instance c96bdeca-16e0-4d90-a9f9-0f9d46799d68 on hv-cinder-86309 Oct 31 19:27:39.377479 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [req-35a96263-da39-4b80-8a9f-420b1a1787e9 req-e9af3ac5-2d59-4d2a-8fb2-3c5e44f490d8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045506 Oct 31 19:27:39.378122 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 439/876] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 31 19:27:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:27:40.179915 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-9c7fbdba-753c-4c6d-bdef-3b8478893eb6 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:27:40.180623 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-9c7fbdba-753c-4c6d-bdef-3b8478893eb6 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] [instance: c96bdeca-16e0-4d90-a9f9-0f9d46799d68] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:27:40.187373 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-9c7fbdba-753c-4c6d-bdef-3b8478893eb6 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:27:40.187864 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-9c7fbdba-753c-4c6d-bdef-3b8478893eb6 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:27:40.188295 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-9c7fbdba-753c-4c6d-bdef-3b8478893eb6 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:27:40.188990 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-9c7fbdba-753c-4c6d-bdef-3b8478893eb6 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:27:40.189440 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-9c7fbdba-753c-4c6d-bdef-3b8478893eb6 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:27:40.189887 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-9c7fbdba-753c-4c6d-bdef-3b8478893eb6 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:27:40.203468 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.wsgi [None req-9c7fbdba-753c-4c6d-bdef-3b8478893eb6 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] HTTP exception thrown: Instance c96bdeca-16e0-4d90-a9f9-0f9d46799d68 could not be found. Oct 31 19:27:40.205137 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-9c7fbdba-753c-4c6d-bdef-3b8478893eb6 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Request method failure captured: Oct 31 19:27:40.205137 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: request: GET /compute/v2.1/servers/c96bdeca-16e0-4d90-a9f9-0f9d46799d68 HTTP/1.1 Oct 31 19:27:40.205137 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Accept: application/json Oct 31 19:27:40.205137 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Accept-Encoding: identity Oct 31 19:27:40.205137 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Connection: close Oct 31 19:27:40.205137 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Content-Length: 0 Oct 31 19:27:40.205137 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Content-Type: application/json Oct 31 19:27:40.205137 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Host: 10.222.0.16 Oct 31 19:27:40.205137 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Openstack-System-Scope: None Oct 31 19:27:40.205137 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: User-Agent: python-urllib3/1.26.12 Oct 31 19:27:40.205137 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Auth-Token: gAAAAABjYCAU5m_sKvtIkeoaXuPr8CXsMHHRJ8qYn0L3UISbpKMC6Z0pOCalmS2pjJiljX1TpBfhLUcE-HOfnv7dP9YkqDtKxSUBmKV_wMMiYXUlgTEkuqkOCyE21_txON-vS2P_OXvwJTxbZwA1-_o3dYm0c9u4nAYGhkBYQU9y0qDg3NDN_14 Oct 31 19:27:40.205137 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Domain-Id: None Oct 31 19:27:40.205137 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Domain-Name: None Oct 31 19:27:40.205137 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Identity-Status: Confirmed Oct 31 19:27:40.205137 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Is-Admin-Project: True Oct 31 19:27:40.205137 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Project-Domain-Id: default Oct 31 19:27:40.205137 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Project-Domain-Name: Default Oct 31 19:27:40.205137 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Project-Id: 3f9c317b548b40deb8cb27236d36d674 Oct 31 19:27:40.205137 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Project-Name: tempest-AttachVolumeTestJSON-190527948 Oct 31 19:27:40.205137 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Role: member,reader Oct 31 19:27:40.205137 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Roles: member,reader Oct 31 19:27:40.206856 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3f9c317b548b40deb8cb27236d36d674"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3f9c317b548b40deb8cb27236d36d674", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3f9c317b548b40deb8cb27236d36d674"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3f9c317b548b40deb8cb27236d36d674"}]}] Oct 31 19:27:40.206856 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Tenant: tempest-AttachVolumeTestJSON-190527948 Oct 31 19:27:40.206856 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Tenant-Id: 3f9c317b548b40deb8cb27236d36d674 Oct 31 19:27:40.206856 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Tenant-Name: tempest-AttachVolumeTestJSON-190527948 Oct 31 19:27:40.206856 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User: tempest-AttachVolumeTestJSON-190527948-project Oct 31 19:27:40.206856 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User-Domain-Id: default Oct 31 19:27:40.206856 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User-Domain-Name: Default Oct 31 19:27:40.206856 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User-Id: ece6ca9374764214bac6263bd691bc4d Oct 31 19:27:40.206856 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User-Name: tempest-AttachVolumeTestJSON-190527948-project Oct 31 19:27:40.206856 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: method: > Oct 31 19:27:40.206856 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: exception: Instance c96bdeca-16e0-4d90-a9f9-0f9d46799d68 could not be found. Oct 31 19:27:40.206856 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: action_args: {'id': 'c96bdeca-16e0-4d90-a9f9-0f9d46799d68'} Oct 31 19:27:40.207703 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 19:27:40.207703 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:27:40.207703 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 19:27:40.207703 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 19:27:40.207703 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 19:27:40.207703 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 19:27:40.207703 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 19:27:40.207703 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 19:27:40.207703 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 19:27:40.207703 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 19:27:40.207703 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c96bdeca-16e0-4d90-a9f9-0f9d46799d68 could not be found. Oct 31 19:27:40.207703 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:27:40.207703 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 19:27:40.207703 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:27:40.207703 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:27:40.207703 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 19:27:40.207703 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 19:27:40.207703 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 19:27:40.207703 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 19:27:40.207703 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 19:27:40.209067 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 19:27:40.209067 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 19:27:40.209067 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 19:27:40.209067 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 19:27:40.209067 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 19:27:40.209067 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 19:27:40.209067 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 19:27:40.209067 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c96bdeca-16e0-4d90-a9f9-0f9d46799d68 could not be found. Oct 31 19:27:40.209067 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:27:40.209067 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 19:27:40.209067 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:27:40.209067 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:27:40.209067 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 19:27:40.209067 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 19:27:40.209067 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 19:27:40.209067 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 19:27:40.209067 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c96bdeca-16e0-4d90-a9f9-0f9d46799d68 could not be found. Oct 31 19:27:40.209067 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:27:40.210285 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-9c7fbdba-753c-4c6d-bdef-3b8478893eb6 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Returning 404 to user: Instance c96bdeca-16e0-4d90-a9f9-0f9d46799d68 could not be found. {{(pid=118727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 19:27:40.210285 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-9c7fbdba-753c-4c6d-bdef-3b8478893eb6 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] 10.222.0.16 "GET /compute/v2.1/servers/c96bdeca-16e0-4d90-a9f9-0f9d46799d68" status: 404 len: 111 microversion: 2.1 time: 0.031170 Oct 31 19:27:40.210285 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 438/877] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:27:40 2022] GET /compute/v2.1/servers/c96bdeca-16e0-4d90-a9f9-0f9d46799d68 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 19:27:40.215844 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-a7e2431c-1cff-43ab-b8b5-244214855674 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Calling method '.version_select at 0x7f34f2011ca0>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:27:40.235591 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-a7e2431c-1cff-43ab-b8b5-244214855674 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-83270829" status: 202 len: 0 microversion: 2.1 time: 0.023768 Oct 31 19:27:40.236174 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 440/878] 10.222.0.16 () {58 vars in 1215 bytes} [Mon Oct 31 19:27:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-83270829 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 31 19:27:43.132840 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-38985fe1-9bc1-4a80-b9e8-5169873eb7ea tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:27:43.133329 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-38985fe1-9bc1-4a80-b9e8-5169873eb7ea tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] [instance: c96bdeca-16e0-4d90-a9f9-0f9d46799d68] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:27:43.139642 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-38985fe1-9bc1-4a80-b9e8-5169873eb7ea tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:27:43.140115 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-38985fe1-9bc1-4a80-b9e8-5169873eb7ea tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:27:43.140542 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-38985fe1-9bc1-4a80-b9e8-5169873eb7ea tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:27:43.141213 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-38985fe1-9bc1-4a80-b9e8-5169873eb7ea tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:27:43.141684 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-38985fe1-9bc1-4a80-b9e8-5169873eb7ea tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:27:43.142103 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-38985fe1-9bc1-4a80-b9e8-5169873eb7ea tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:27:43.155590 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.wsgi [None req-38985fe1-9bc1-4a80-b9e8-5169873eb7ea tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] HTTP exception thrown: Instance c96bdeca-16e0-4d90-a9f9-0f9d46799d68 could not be found. Oct 31 19:27:43.157079 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-38985fe1-9bc1-4a80-b9e8-5169873eb7ea tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Request method failure captured: Oct 31 19:27:43.157079 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: request: DELETE /compute/v2.1/servers/c96bdeca-16e0-4d90-a9f9-0f9d46799d68 HTTP/1.1 Oct 31 19:27:43.157079 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Accept: application/json Oct 31 19:27:43.157079 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Accept-Encoding: identity Oct 31 19:27:43.157079 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Connection: close Oct 31 19:27:43.157079 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Content-Length: 0 Oct 31 19:27:43.157079 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Content-Type: application/json Oct 31 19:27:43.157079 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Host: 10.222.0.16 Oct 31 19:27:43.157079 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Openstack-System-Scope: None Oct 31 19:27:43.157079 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: User-Agent: python-urllib3/1.26.12 Oct 31 19:27:43.157079 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Auth-Token: gAAAAABjYCAU5m_sKvtIkeoaXuPr8CXsMHHRJ8qYn0L3UISbpKMC6Z0pOCalmS2pjJiljX1TpBfhLUcE-HOfnv7dP9YkqDtKxSUBmKV_wMMiYXUlgTEkuqkOCyE21_txON-vS2P_OXvwJTxbZwA1-_o3dYm0c9u4nAYGhkBYQU9y0qDg3NDN_14 Oct 31 19:27:43.157079 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Domain-Id: None Oct 31 19:27:43.157079 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Domain-Name: None Oct 31 19:27:43.157079 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Identity-Status: Confirmed Oct 31 19:27:43.157079 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Is-Admin-Project: True Oct 31 19:27:43.157079 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Project-Domain-Id: default Oct 31 19:27:43.157079 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Project-Domain-Name: Default Oct 31 19:27:43.157079 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Project-Id: 3f9c317b548b40deb8cb27236d36d674 Oct 31 19:27:43.157079 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Project-Name: tempest-AttachVolumeTestJSON-190527948 Oct 31 19:27:43.157079 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Role: member,reader Oct 31 19:27:43.157079 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Roles: member,reader Oct 31 19:27:43.158646 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3f9c317b548b40deb8cb27236d36d674"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3f9c317b548b40deb8cb27236d36d674", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3f9c317b548b40deb8cb27236d36d674"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3f9c317b548b40deb8cb27236d36d674"}]}] Oct 31 19:27:43.158646 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Tenant: tempest-AttachVolumeTestJSON-190527948 Oct 31 19:27:43.158646 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Tenant-Id: 3f9c317b548b40deb8cb27236d36d674 Oct 31 19:27:43.158646 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Tenant-Name: tempest-AttachVolumeTestJSON-190527948 Oct 31 19:27:43.158646 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User: tempest-AttachVolumeTestJSON-190527948-project Oct 31 19:27:43.158646 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User-Domain-Id: default Oct 31 19:27:43.158646 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User-Domain-Name: Default Oct 31 19:27:43.158646 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User-Id: ece6ca9374764214bac6263bd691bc4d Oct 31 19:27:43.158646 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User-Name: tempest-AttachVolumeTestJSON-190527948-project Oct 31 19:27:43.158646 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: method: > Oct 31 19:27:43.158646 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: exception: Instance c96bdeca-16e0-4d90-a9f9-0f9d46799d68 could not be found. Oct 31 19:27:43.158646 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: action_args: {'id': 'c96bdeca-16e0-4d90-a9f9-0f9d46799d68'} Oct 31 19:27:43.159486 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 19:27:43.159486 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:27:43.159486 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 19:27:43.159486 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 19:27:43.159486 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 19:27:43.159486 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 19:27:43.159486 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 19:27:43.159486 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 19:27:43.159486 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 19:27:43.159486 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 19:27:43.159486 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c96bdeca-16e0-4d90-a9f9-0f9d46799d68 could not be found. Oct 31 19:27:43.159486 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:27:43.159486 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 19:27:43.159486 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:27:43.159486 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:27:43.159486 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 19:27:43.159486 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 19:27:43.159486 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 19:27:43.159486 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 19:27:43.159486 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 19:27:43.160926 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 19:27:43.160926 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 19:27:43.160926 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 19:27:43.160926 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 19:27:43.160926 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 19:27:43.160926 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 19:27:43.160926 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 19:27:43.160926 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 19:27:43.160926 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 19:27:43.160926 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c96bdeca-16e0-4d90-a9f9-0f9d46799d68 could not be found. Oct 31 19:27:43.160926 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:27:43.160926 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 19:27:43.160926 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:27:43.160926 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:27:43.160926 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 19:27:43.160926 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 19:27:43.160926 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 19:27:43.160926 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 19:27:43.160926 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c96bdeca-16e0-4d90-a9f9-0f9d46799d68 could not be found. Oct 31 19:27:43.160926 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:27:43.162350 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-38985fe1-9bc1-4a80-b9e8-5169873eb7ea tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Returning 404 to user: Instance c96bdeca-16e0-4d90-a9f9-0f9d46799d68 could not be found. {{(pid=118727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 19:27:43.162350 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-38985fe1-9bc1-4a80-b9e8-5169873eb7ea tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c96bdeca-16e0-4d90-a9f9-0f9d46799d68" status: 404 len: 111 microversion: 2.1 time: 0.029889 Oct 31 19:27:43.162350 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 439/879] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 31 19:27:43 2022] DELETE /compute/v2.1/servers/c96bdeca-16e0-4d90-a9f9-0f9d46799d68 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 19:27:43.167103 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-a051db84-4531-4b82-ae58-cdfdc0f36633 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:27:43.167841 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-a051db84-4531-4b82-ae58-cdfdc0f36633 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] [instance: c96bdeca-16e0-4d90-a9f9-0f9d46799d68] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:27:43.174852 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-a051db84-4531-4b82-ae58-cdfdc0f36633 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:27:43.175340 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-a051db84-4531-4b82-ae58-cdfdc0f36633 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:27:43.175773 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-a051db84-4531-4b82-ae58-cdfdc0f36633 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:27:43.176459 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-a051db84-4531-4b82-ae58-cdfdc0f36633 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:27:43.176915 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-a051db84-4531-4b82-ae58-cdfdc0f36633 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:27:43.177339 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-a051db84-4531-4b82-ae58-cdfdc0f36633 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:27:43.190122 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.wsgi [None req-a051db84-4531-4b82-ae58-cdfdc0f36633 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] HTTP exception thrown: Instance c96bdeca-16e0-4d90-a9f9-0f9d46799d68 could not be found. Oct 31 19:27:43.192231 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-a051db84-4531-4b82-ae58-cdfdc0f36633 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Request method failure captured: Oct 31 19:27:43.192231 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: request: GET /compute/v2.1/servers/c96bdeca-16e0-4d90-a9f9-0f9d46799d68 HTTP/1.1 Oct 31 19:27:43.192231 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: Accept: application/json Oct 31 19:27:43.192231 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: Accept-Encoding: identity Oct 31 19:27:43.192231 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: Connection: close Oct 31 19:27:43.192231 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: Content-Length: 0 Oct 31 19:27:43.192231 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: Content-Type: application/json Oct 31 19:27:43.192231 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: Host: 10.222.0.16 Oct 31 19:27:43.192231 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: Openstack-System-Scope: None Oct 31 19:27:43.192231 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: User-Agent: python-urllib3/1.26.12 Oct 31 19:27:43.192231 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Auth-Token: gAAAAABjYCAU5m_sKvtIkeoaXuPr8CXsMHHRJ8qYn0L3UISbpKMC6Z0pOCalmS2pjJiljX1TpBfhLUcE-HOfnv7dP9YkqDtKxSUBmKV_wMMiYXUlgTEkuqkOCyE21_txON-vS2P_OXvwJTxbZwA1-_o3dYm0c9u4nAYGhkBYQU9y0qDg3NDN_14 Oct 31 19:27:43.192231 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Domain-Id: None Oct 31 19:27:43.192231 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Domain-Name: None Oct 31 19:27:43.192231 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Identity-Status: Confirmed Oct 31 19:27:43.192231 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Is-Admin-Project: True Oct 31 19:27:43.192231 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Project-Domain-Id: default Oct 31 19:27:43.192231 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Project-Domain-Name: Default Oct 31 19:27:43.192231 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Project-Id: 3f9c317b548b40deb8cb27236d36d674 Oct 31 19:27:43.192231 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Project-Name: tempest-AttachVolumeTestJSON-190527948 Oct 31 19:27:43.192231 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Role: member,reader Oct 31 19:27:43.192231 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Roles: member,reader Oct 31 19:27:43.193821 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3f9c317b548b40deb8cb27236d36d674"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3f9c317b548b40deb8cb27236d36d674", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3f9c317b548b40deb8cb27236d36d674"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3f9c317b548b40deb8cb27236d36d674"}]}] Oct 31 19:27:43.193821 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Tenant: tempest-AttachVolumeTestJSON-190527948 Oct 31 19:27:43.193821 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Tenant-Id: 3f9c317b548b40deb8cb27236d36d674 Oct 31 19:27:43.193821 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Tenant-Name: tempest-AttachVolumeTestJSON-190527948 Oct 31 19:27:43.193821 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-User: tempest-AttachVolumeTestJSON-190527948-project Oct 31 19:27:43.193821 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-User-Domain-Id: default Oct 31 19:27:43.193821 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-User-Domain-Name: Default Oct 31 19:27:43.193821 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-User-Id: ece6ca9374764214bac6263bd691bc4d Oct 31 19:27:43.193821 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-User-Name: tempest-AttachVolumeTestJSON-190527948-project Oct 31 19:27:43.193821 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: method: > Oct 31 19:27:43.193821 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: exception: Instance c96bdeca-16e0-4d90-a9f9-0f9d46799d68 could not be found. Oct 31 19:27:43.193821 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: action_args: {'id': 'c96bdeca-16e0-4d90-a9f9-0f9d46799d68'} Oct 31 19:27:43.194704 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 19:27:43.194704 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:27:43.194704 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 19:27:43.194704 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 19:27:43.194704 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 19:27:43.194704 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 19:27:43.194704 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 19:27:43.194704 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 19:27:43.194704 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 19:27:43.194704 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 19:27:43.194704 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c96bdeca-16e0-4d90-a9f9-0f9d46799d68 could not be found. Oct 31 19:27:43.194704 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Oct 31 19:27:43.194704 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 19:27:43.194704 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Oct 31 19:27:43.194704 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:27:43.194704 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 19:27:43.194704 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 19:27:43.194704 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 19:27:43.194704 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 19:27:43.194704 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 19:27:43.196193 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 19:27:43.196193 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 19:27:43.196193 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 19:27:43.196193 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 19:27:43.196193 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 19:27:43.196193 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 19:27:43.196193 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 19:27:43.196193 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c96bdeca-16e0-4d90-a9f9-0f9d46799d68 could not be found. Oct 31 19:27:43.196193 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Oct 31 19:27:43.196193 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 19:27:43.196193 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Oct 31 19:27:43.196193 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:27:43.196193 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 19:27:43.196193 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 19:27:43.196193 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 19:27:43.196193 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 19:27:43.196193 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c96bdeca-16e0-4d90-a9f9-0f9d46799d68 could not be found. Oct 31 19:27:43.196193 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Oct 31 19:27:43.197445 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-a051db84-4531-4b82-ae58-cdfdc0f36633 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Returning 404 to user: Instance c96bdeca-16e0-4d90-a9f9-0f9d46799d68 could not be found. {{(pid=118726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 19:27:43.197445 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-a051db84-4531-4b82-ae58-cdfdc0f36633 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] 10.222.0.16 "GET /compute/v2.1/servers/c96bdeca-16e0-4d90-a9f9-0f9d46799d68" status: 404 len: 111 microversion: 2.1 time: 0.030681 Oct 31 19:27:43.197445 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 441/880] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:27:43 2022] GET /compute/v2.1/servers/c96bdeca-16e0-4d90-a9f9-0f9d46799d68 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 19:27:44.330957 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-383123a3-1fd6-43cf-8586-fe51d504989f tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:27:44.331510 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-383123a3-1fd6-43cf-8586-fe51d504989f tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] [instance: 0a122a08-bc0f-40fd-8139-74c9e8a70ebe] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:27:44.343353 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-383123a3-1fd6-43cf-8586-fe51d504989f tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:27:44.344890 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-383123a3-1fd6-43cf-8586-fe51d504989f tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:27:44.345368 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-383123a3-1fd6-43cf-8586-fe51d504989f tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:27:44.346103 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-383123a3-1fd6-43cf-8586-fe51d504989f tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:27:44.346563 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-383123a3-1fd6-43cf-8586-fe51d504989f tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:27:44.346987 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-383123a3-1fd6-43cf-8586-fe51d504989f tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:27:44.360251 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.wsgi [None req-383123a3-1fd6-43cf-8586-fe51d504989f tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] HTTP exception thrown: Instance 0a122a08-bc0f-40fd-8139-74c9e8a70ebe could not be found. Oct 31 19:27:44.361807 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-383123a3-1fd6-43cf-8586-fe51d504989f tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Request method failure captured: Oct 31 19:27:44.361807 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: request: DELETE /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe HTTP/1.1 Oct 31 19:27:44.361807 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Accept: application/json Oct 31 19:27:44.361807 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Accept-Encoding: identity Oct 31 19:27:44.361807 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Connection: close Oct 31 19:27:44.361807 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Content-Length: 0 Oct 31 19:27:44.361807 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Content-Type: application/json Oct 31 19:27:44.361807 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Host: 10.222.0.16 Oct 31 19:27:44.361807 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Openstack-System-Scope: None Oct 31 19:27:44.361807 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: User-Agent: python-urllib3/1.26.12 Oct 31 19:27:44.361807 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Auth-Token: gAAAAABjYCAU5m_sKvtIkeoaXuPr8CXsMHHRJ8qYn0L3UISbpKMC6Z0pOCalmS2pjJiljX1TpBfhLUcE-HOfnv7dP9YkqDtKxSUBmKV_wMMiYXUlgTEkuqkOCyE21_txON-vS2P_OXvwJTxbZwA1-_o3dYm0c9u4nAYGhkBYQU9y0qDg3NDN_14 Oct 31 19:27:44.361807 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Domain-Id: None Oct 31 19:27:44.361807 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Domain-Name: None Oct 31 19:27:44.361807 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Identity-Status: Confirmed Oct 31 19:27:44.361807 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Is-Admin-Project: True Oct 31 19:27:44.361807 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Project-Domain-Id: default Oct 31 19:27:44.361807 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Project-Domain-Name: Default Oct 31 19:27:44.361807 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Project-Id: 3f9c317b548b40deb8cb27236d36d674 Oct 31 19:27:44.361807 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Project-Name: tempest-AttachVolumeTestJSON-190527948 Oct 31 19:27:44.361807 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Role: member,reader Oct 31 19:27:44.361807 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Roles: member,reader Oct 31 19:27:44.363879 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3f9c317b548b40deb8cb27236d36d674"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3f9c317b548b40deb8cb27236d36d674", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3f9c317b548b40deb8cb27236d36d674"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3f9c317b548b40deb8cb27236d36d674"}]}] Oct 31 19:27:44.363879 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Tenant: tempest-AttachVolumeTestJSON-190527948 Oct 31 19:27:44.363879 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Tenant-Id: 3f9c317b548b40deb8cb27236d36d674 Oct 31 19:27:44.363879 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Tenant-Name: tempest-AttachVolumeTestJSON-190527948 Oct 31 19:27:44.363879 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User: tempest-AttachVolumeTestJSON-190527948-project Oct 31 19:27:44.363879 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User-Domain-Id: default Oct 31 19:27:44.363879 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User-Domain-Name: Default Oct 31 19:27:44.363879 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User-Id: ece6ca9374764214bac6263bd691bc4d Oct 31 19:27:44.363879 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User-Name: tempest-AttachVolumeTestJSON-190527948-project Oct 31 19:27:44.363879 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: method: > Oct 31 19:27:44.363879 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: exception: Instance 0a122a08-bc0f-40fd-8139-74c9e8a70ebe could not be found. Oct 31 19:27:44.363879 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: action_args: {'id': '0a122a08-bc0f-40fd-8139-74c9e8a70ebe'} Oct 31 19:27:44.364670 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 19:27:44.364670 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:27:44.364670 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 19:27:44.364670 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 19:27:44.364670 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 19:27:44.364670 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 19:27:44.364670 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 19:27:44.364670 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 19:27:44.364670 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 19:27:44.364670 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 19:27:44.364670 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a122a08-bc0f-40fd-8139-74c9e8a70ebe could not be found. Oct 31 19:27:44.364670 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:27:44.364670 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 19:27:44.364670 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:27:44.364670 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:27:44.364670 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 19:27:44.364670 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 19:27:44.364670 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 19:27:44.364670 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 19:27:44.364670 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 19:27:44.366651 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 19:27:44.366651 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 19:27:44.366651 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 19:27:44.366651 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 19:27:44.366651 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 19:27:44.366651 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 19:27:44.366651 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 19:27:44.366651 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 19:27:44.366651 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 19:27:44.366651 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a122a08-bc0f-40fd-8139-74c9e8a70ebe could not be found. Oct 31 19:27:44.366651 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:27:44.366651 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 19:27:44.366651 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:27:44.366651 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:27:44.366651 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 19:27:44.366651 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 19:27:44.366651 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 19:27:44.366651 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 19:27:44.366651 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a122a08-bc0f-40fd-8139-74c9e8a70ebe could not be found. Oct 31 19:27:44.366651 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:27:44.368096 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-383123a3-1fd6-43cf-8586-fe51d504989f tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Returning 404 to user: Instance 0a122a08-bc0f-40fd-8139-74c9e8a70ebe could not be found. {{(pid=118727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 19:27:44.368096 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-383123a3-1fd6-43cf-8586-fe51d504989f tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] 10.222.0.16 "DELETE /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe" status: 404 len: 111 microversion: 2.1 time: 0.036767 Oct 31 19:27:44.368096 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 440/881] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 31 19:27:44 2022] DELETE /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 19:27:44.372229 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-28027978-e512-497f-83a9-4ce6cbd4c961 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:27:44.372872 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-28027978-e512-497f-83a9-4ce6cbd4c961 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] [instance: 0a122a08-bc0f-40fd-8139-74c9e8a70ebe] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:27:44.375449 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG dbcounter [-] [118726] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:27:44.381828 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-28027978-e512-497f-83a9-4ce6cbd4c961 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:27:44.382333 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-28027978-e512-497f-83a9-4ce6cbd4c961 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:27:44.382770 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-28027978-e512-497f-83a9-4ce6cbd4c961 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:27:44.383456 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-28027978-e512-497f-83a9-4ce6cbd4c961 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:27:44.383912 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-28027978-e512-497f-83a9-4ce6cbd4c961 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:27:44.384335 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-28027978-e512-497f-83a9-4ce6cbd4c961 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:27:44.399130 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.wsgi [None req-28027978-e512-497f-83a9-4ce6cbd4c961 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] HTTP exception thrown: Instance 0a122a08-bc0f-40fd-8139-74c9e8a70ebe could not be found. Oct 31 19:27:44.400725 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-28027978-e512-497f-83a9-4ce6cbd4c961 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Request method failure captured: Oct 31 19:27:44.400725 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: request: GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe HTTP/1.1 Oct 31 19:27:44.400725 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: Accept: application/json Oct 31 19:27:44.400725 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: Accept-Encoding: identity Oct 31 19:27:44.400725 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: Connection: close Oct 31 19:27:44.400725 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: Content-Length: 0 Oct 31 19:27:44.400725 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: Content-Type: application/json Oct 31 19:27:44.400725 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: Host: 10.222.0.16 Oct 31 19:27:44.400725 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: Openstack-System-Scope: None Oct 31 19:27:44.400725 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: User-Agent: python-urllib3/1.26.12 Oct 31 19:27:44.400725 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Auth-Token: gAAAAABjYCAU5m_sKvtIkeoaXuPr8CXsMHHRJ8qYn0L3UISbpKMC6Z0pOCalmS2pjJiljX1TpBfhLUcE-HOfnv7dP9YkqDtKxSUBmKV_wMMiYXUlgTEkuqkOCyE21_txON-vS2P_OXvwJTxbZwA1-_o3dYm0c9u4nAYGhkBYQU9y0qDg3NDN_14 Oct 31 19:27:44.400725 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Domain-Id: None Oct 31 19:27:44.400725 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Domain-Name: None Oct 31 19:27:44.400725 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Identity-Status: Confirmed Oct 31 19:27:44.400725 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Is-Admin-Project: True Oct 31 19:27:44.400725 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Project-Domain-Id: default Oct 31 19:27:44.400725 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Project-Domain-Name: Default Oct 31 19:27:44.400725 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Project-Id: 3f9c317b548b40deb8cb27236d36d674 Oct 31 19:27:44.400725 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Project-Name: tempest-AttachVolumeTestJSON-190527948 Oct 31 19:27:44.400725 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Role: member,reader Oct 31 19:27:44.400725 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Roles: member,reader Oct 31 19:27:44.402380 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3f9c317b548b40deb8cb27236d36d674"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3f9c317b548b40deb8cb27236d36d674", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3f9c317b548b40deb8cb27236d36d674"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3f9c317b548b40deb8cb27236d36d674"}]}] Oct 31 19:27:44.402380 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Tenant: tempest-AttachVolumeTestJSON-190527948 Oct 31 19:27:44.402380 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Tenant-Id: 3f9c317b548b40deb8cb27236d36d674 Oct 31 19:27:44.402380 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Tenant-Name: tempest-AttachVolumeTestJSON-190527948 Oct 31 19:27:44.402380 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-User: tempest-AttachVolumeTestJSON-190527948-project Oct 31 19:27:44.402380 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-User-Domain-Id: default Oct 31 19:27:44.402380 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-User-Domain-Name: Default Oct 31 19:27:44.402380 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-User-Id: ece6ca9374764214bac6263bd691bc4d Oct 31 19:27:44.402380 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-User-Name: tempest-AttachVolumeTestJSON-190527948-project Oct 31 19:27:44.402380 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: method: > Oct 31 19:27:44.402380 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: exception: Instance 0a122a08-bc0f-40fd-8139-74c9e8a70ebe could not be found. Oct 31 19:27:44.402380 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: action_args: {'id': '0a122a08-bc0f-40fd-8139-74c9e8a70ebe'} Oct 31 19:27:44.403309 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 19:27:44.403309 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:27:44.403309 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 19:27:44.403309 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 19:27:44.403309 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 19:27:44.403309 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 19:27:44.403309 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 19:27:44.403309 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 19:27:44.403309 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 19:27:44.403309 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 19:27:44.403309 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a122a08-bc0f-40fd-8139-74c9e8a70ebe could not be found. Oct 31 19:27:44.403309 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Oct 31 19:27:44.403309 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 19:27:44.403309 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Oct 31 19:27:44.403309 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:27:44.403309 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 19:27:44.403309 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 19:27:44.403309 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 19:27:44.403309 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 19:27:44.403309 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 19:27:44.404767 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 19:27:44.404767 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 19:27:44.404767 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 19:27:44.404767 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 19:27:44.404767 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 19:27:44.404767 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 19:27:44.404767 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 19:27:44.404767 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a122a08-bc0f-40fd-8139-74c9e8a70ebe could not be found. Oct 31 19:27:44.404767 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Oct 31 19:27:44.404767 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 19:27:44.404767 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Oct 31 19:27:44.404767 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:27:44.404767 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 19:27:44.404767 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 19:27:44.404767 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 19:27:44.404767 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 19:27:44.404767 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a122a08-bc0f-40fd-8139-74c9e8a70ebe could not be found. Oct 31 19:27:44.404767 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Oct 31 19:27:44.406099 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-28027978-e512-497f-83a9-4ce6cbd4c961 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] Returning 404 to user: Instance 0a122a08-bc0f-40fd-8139-74c9e8a70ebe could not be found. {{(pid=118726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 19:27:44.406099 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-28027978-e512-497f-83a9-4ce6cbd4c961 tempest-AttachVolumeTestJSON-190527948 tempest-AttachVolumeTestJSON-190527948-project] 10.222.0.16 "GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe" status: 404 len: 111 microversion: 2.1 time: 0.033962 Oct 31 19:27:44.406099 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 442/882] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:27:44 2022] GET /compute/v2.1/servers/0a122a08-bc0f-40fd-8139-74c9e8a70ebe => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 19:27:53.457221 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-e2e29500-a889-4f64-8e47-462c23aae372 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Action: 'create', calling method: .version_select at 0x7f34f58c3550>, body: {"keypair": {"name": "tempest-keypair-1910957442", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJTAiWjAA3JOboBMMzos8z2zJM8hMczrQNCKTQ9hgSA3EIfeP1+/uEONehwAVP0GgNLp0JdrjILnSQ8Kzk/PeSLDn6Q/GWgfNlG3I4vXly8bN5DlafxOE+yJdv4omMBSZQ=="}} {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:27:53.475256 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.quota [None req-e2e29500-a889-4f64-8e47-462c23aae372 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Getting quotas for project adba9bc456234ea6ade63d41a1624967. Resources: {'key_pairs'} {{(pid=118727) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 19:27:53.479091 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.quota [None req-e2e29500-a889-4f64-8e47-462c23aae372 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Getting quotas for user 16778b0dd21d41eeaa6087b67931eef8 and project adba9bc456234ea6ade63d41a1624967. Resources: {'key_pairs'} {{(pid=118727) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 19:27:53.502712 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-e2e29500-a889-4f64-8e47-462c23aae372 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.165529 Oct 31 19:27:53.503242 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 441/883] 10.222.0.16 () {60 vars in 1159 bytes} [Mon Oct 31 19:27:53 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:27:54.784997 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-46d3f9f0-4986-4bf0-9d9f-606d801c7a8f tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-284877446", "imageRef": "a9795ee0-6722-4e1e-8fc8-a6c2e68f3049", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fa342027-4076-4973-b2c6-612147f6fd68"}], "security_groups": [{"name": "tempest-securitygroup--584289690"}], "key_name": "tempest-keypair-1910957442", "user_data": "}} {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:27:54.804702 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG dbcounter [-] [118726] Writing DB stats nova_cell1:SELECT=11 {{(pid=118726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:27:54.805523 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG dbcounter [-] [118726] Writing DB stats nova_api:SELECT=1 {{(pid=118726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:27:54.897047 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.network.neutron [None req-46d3f9f0-4986-4bf0-9d9f-606d801c7a8f tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] validate_networks() for [('fa342027-4076-4973-b2c6-612147f6fd68', None, None, None, None, None)] {{(pid=118726) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 19:27:55.273830 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.virt.hardware [None req-46d3f9f0-4986-4bf0-9d9f-606d801c7a8f tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Flavor limits 0:0:0 {{(pid=118726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 19:27:55.274259 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.virt.hardware [None req-46d3f9f0-4986-4bf0-9d9f-606d801c7a8f tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Image limits 0:0:0 {{(pid=118726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 19:27:55.277998 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.virt.hardware [None req-46d3f9f0-4986-4bf0-9d9f-606d801c7a8f tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Flavor pref 0:0:0 {{(pid=118726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 19:27:55.278514 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.virt.hardware [None req-46d3f9f0-4986-4bf0-9d9f-606d801c7a8f tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Image pref 0:0:0 {{(pid=118726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 19:27:55.278851 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.virt.hardware [None req-46d3f9f0-4986-4bf0-9d9f-606d801c7a8f tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 19:27:55.291243 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-46d3f9f0-4986-4bf0-9d9f-606d801c7a8f tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:27:55.291243 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-46d3f9f0-4986-4bf0-9d9f-606d801c7a8f tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:27:55.291472 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-46d3f9f0-4986-4bf0-9d9f-606d801c7a8f tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:27:55.295058 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-46d3f9f0-4986-4bf0-9d9f-606d801c7a8f tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:27:55.295058 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-46d3f9f0-4986-4bf0-9d9f-606d801c7a8f tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:27:55.295058 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-46d3f9f0-4986-4bf0-9d9f-606d801c7a8f tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:27:55.320195 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.quota [None req-46d3f9f0-4986-4bf0-9d9f-606d801c7a8f tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Getting quotas for project adba9bc456234ea6ade63d41a1624967. Resources: {'instances', 'ram', 'cores'} {{(pid=118726) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 19:27:55.324358 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.quota [None req-46d3f9f0-4986-4bf0-9d9f-606d801c7a8f tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Getting quotas for user 16778b0dd21d41eeaa6087b67931eef8 and project adba9bc456234ea6ade63d41a1624967. Resources: {'instances', 'ram', 'cores'} {{(pid=118726) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 19:27:55.335831 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-46d3f9f0-4986-4bf0-9d9f-606d801c7a8f tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Going to run 1 instances... {{(pid=118726) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 19:27:55.338397 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-46d3f9f0-4986-4bf0-9d9f-606d801c7a8f tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] [instance: 1fd43154-badc-47b6-a5a7-d1f28e759bb0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9795ee0-6722-4e1e-8fc8-a6c2e68f3049',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118726) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 19:27:55.387359 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-46d3f9f0-4986-4bf0-9d9f-606d801c7a8f tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.607298 Oct 31 19:27:55.388115 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 443/884] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 31 19:27:54 2022] POST /compute/v2.1/servers => generated 401 bytes in 609 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 19:27:55.397500 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG dbcounter [-] [118727] Writing DB stats nova_cell1:SELECT=48,nova_cell1:INSERT=2 {{(pid=118727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:27:55.402641 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-68f01d34-f71a-468b-967b-8e4c70077070 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:27:55.403481 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-68f01d34-f71a-468b-967b-8e4c70077070 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] [instance: 1fd43154-badc-47b6-a5a7-d1f28e759bb0] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:27:55.470597 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-68f01d34-f71a-468b-967b-8e4c70077070 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16778b0dd21d41eeaa6087b67931eef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba9bc456234ea6ade63d41a1624967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:27:55.480118 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-68f01d34-f71a-468b-967b-8e4c70077070 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] 10.222.0.16 "GET /compute/v2.1/servers/1fd43154-badc-47b6-a5a7-d1f28e759bb0" status: 200 len: 1241 microversion: 2.1 time: 0.084064 Oct 31 19:27:55.480701 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 442/885] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:27:55 2022] GET /compute/v2.1/servers/1fd43154-badc-47b6-a5a7-d1f28e759bb0 => generated 1241 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:27:56.505575 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-4df7f95f-4fef-4fd8-9e65-bf2c5abcffb3 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:27:56.506988 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-4df7f95f-4fef-4fd8-9e65-bf2c5abcffb3 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] [instance: 1fd43154-badc-47b6-a5a7-d1f28e759bb0] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:27:56.520929 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-4df7f95f-4fef-4fd8-9e65-bf2c5abcffb3 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:27:56.521738 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-4df7f95f-4fef-4fd8-9e65-bf2c5abcffb3 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:27:56.522177 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-4df7f95f-4fef-4fd8-9e65-bf2c5abcffb3 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:27:56.523625 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-4df7f95f-4fef-4fd8-9e65-bf2c5abcffb3 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:27:56.524446 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-4df7f95f-4fef-4fd8-9e65-bf2c5abcffb3 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:27:56.525035 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-4df7f95f-4fef-4fd8-9e65-bf2c5abcffb3 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:27:56.599935 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-4df7f95f-4fef-4fd8-9e65-bf2c5abcffb3 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16778b0dd21d41eeaa6087b67931eef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba9bc456234ea6ade63d41a1624967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:27:56.610108 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-4df7f95f-4fef-4fd8-9e65-bf2c5abcffb3 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] 10.222.0.16 "GET /compute/v2.1/servers/1fd43154-badc-47b6-a5a7-d1f28e759bb0" status: 200 len: 1301 microversion: 2.1 time: 0.109672 Oct 31 19:27:56.611648 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 444/886] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:27:56 2022] GET /compute/v2.1/servers/1fd43154-badc-47b6-a5a7-d1f28e759bb0 => generated 1301 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:27:57.637334 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-e2e3a2f8-2785-4406-b3e8-23a416b1a4a3 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:27:57.637986 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-e2e3a2f8-2785-4406-b3e8-23a416b1a4a3 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] [instance: 1fd43154-badc-47b6-a5a7-d1f28e759bb0] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:27:57.645237 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-e2e3a2f8-2785-4406-b3e8-23a416b1a4a3 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:27:57.645763 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-e2e3a2f8-2785-4406-b3e8-23a416b1a4a3 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:27:57.646203 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-e2e3a2f8-2785-4406-b3e8-23a416b1a4a3 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:27:57.646894 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-e2e3a2f8-2785-4406-b3e8-23a416b1a4a3 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:27:57.647350 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-e2e3a2f8-2785-4406-b3e8-23a416b1a4a3 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:27:57.647932 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-e2e3a2f8-2785-4406-b3e8-23a416b1a4a3 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:27:57.891314 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-e2e3a2f8-2785-4406-b3e8-23a416b1a4a3 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16778b0dd21d41eeaa6087b67931eef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba9bc456234ea6ade63d41a1624967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:27:57.899683 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-e2e3a2f8-2785-4406-b3e8-23a416b1a4a3 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] 10.222.0.16 "GET /compute/v2.1/servers/1fd43154-badc-47b6-a5a7-d1f28e759bb0" status: 200 len: 1366 microversion: 2.1 time: 0.266153 Oct 31 19:27:57.900249 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 443/887] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:27:57 2022] GET /compute/v2.1/servers/1fd43154-badc-47b6-a5a7-d1f28e759bb0 => generated 1366 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:27:58.047012 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [req-1596c163-35dd-4972-a593-ed0c4cdcdcc5 req-3df79b77-d2b3-4a51-940a-b71833f2a004 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1fd43154-badc-47b6-a5a7-d1f28e759bb0", "tag": "03f69bfc-980f-40fa-86a8-15bddfdfdfd1"}]} {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:27:58.057745 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [req-1596c163-35dd-4972-a593-ed0c4cdcdcc5 req-3df79b77-d2b3-4a51-940a-b71833f2a004 service nova] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:27:58.058362 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [req-1596c163-35dd-4972-a593-ed0c4cdcdcc5 req-3df79b77-d2b3-4a51-940a-b71833f2a004 service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:27:58.058864 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [req-1596c163-35dd-4972-a593-ed0c4cdcdcc5 req-3df79b77-d2b3-4a51-940a-b71833f2a004 service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:27:58.072001 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.compute.server_external_events [req-1596c163-35dd-4972-a593-ed0c4cdcdcc5 req-3df79b77-d2b3-4a51-940a-b71833f2a004 service nova] Creating event network-changed:03f69bfc-980f-40fa-86a8-15bddfdfdfd1 for instance 1fd43154-badc-47b6-a5a7-d1f28e759bb0 on hv-cinder-86309 Oct 31 19:27:58.078781 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [req-1596c163-35dd-4972-a593-ed0c4cdcdcc5 req-3df79b77-d2b3-4a51-940a-b71833f2a004 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035342 Oct 31 19:27:58.080246 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 445/888] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 31 19:27:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 19:27:58.921884 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-ed99a565-bdb0-47e9-aad6-ee6914616391 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:27:58.922488 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-ed99a565-bdb0-47e9-aad6-ee6914616391 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] [instance: 1fd43154-badc-47b6-a5a7-d1f28e759bb0] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:27:58.929490 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-ed99a565-bdb0-47e9-aad6-ee6914616391 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:27:58.929953 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-ed99a565-bdb0-47e9-aad6-ee6914616391 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:27:58.930379 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-ed99a565-bdb0-47e9-aad6-ee6914616391 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:27:58.931061 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-ed99a565-bdb0-47e9-aad6-ee6914616391 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:27:58.931505 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-ed99a565-bdb0-47e9-aad6-ee6914616391 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:27:58.931921 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-ed99a565-bdb0-47e9-aad6-ee6914616391 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:27:59.060253 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-ed99a565-bdb0-47e9-aad6-ee6914616391 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16778b0dd21d41eeaa6087b67931eef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba9bc456234ea6ade63d41a1624967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:27:59.067846 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-ed99a565-bdb0-47e9-aad6-ee6914616391 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] 10.222.0.16 "GET /compute/v2.1/servers/1fd43154-badc-47b6-a5a7-d1f28e759bb0" status: 200 len: 1366 microversion: 2.1 time: 0.149848 Oct 31 19:27:59.068407 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 444/889] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:27:58 2022] GET /compute/v2.1/servers/1fd43154-badc-47b6-a5a7-d1f28e759bb0 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:28:00.091370 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-c33b2f74-c1e3-4226-ba7a-700a5a14200e tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:28:00.092068 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-c33b2f74-c1e3-4226-ba7a-700a5a14200e tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] [instance: 1fd43154-badc-47b6-a5a7-d1f28e759bb0] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:28:00.099244 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-c33b2f74-c1e3-4226-ba7a-700a5a14200e tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:28:00.099719 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-c33b2f74-c1e3-4226-ba7a-700a5a14200e tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:28:00.100183 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-c33b2f74-c1e3-4226-ba7a-700a5a14200e tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:28:00.100892 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-c33b2f74-c1e3-4226-ba7a-700a5a14200e tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:28:00.101345 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-c33b2f74-c1e3-4226-ba7a-700a5a14200e tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:28:00.101794 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-c33b2f74-c1e3-4226-ba7a-700a5a14200e tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:28:00.234961 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-c33b2f74-c1e3-4226-ba7a-700a5a14200e tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16778b0dd21d41eeaa6087b67931eef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba9bc456234ea6ade63d41a1624967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:28:00.242791 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-c33b2f74-c1e3-4226-ba7a-700a5a14200e tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] 10.222.0.16 "GET /compute/v2.1/servers/1fd43154-badc-47b6-a5a7-d1f28e759bb0" status: 200 len: 1366 microversion: 2.1 time: 0.155589 Oct 31 19:28:00.243444 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 446/890] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:28:00 2022] GET /compute/v2.1/servers/1fd43154-badc-47b6-a5a7-d1f28e759bb0 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:28:01.266658 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-6a9f1ace-2af2-4314-86ff-298499fea6ea tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:28:01.267318 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-6a9f1ace-2af2-4314-86ff-298499fea6ea tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] [instance: 1fd43154-badc-47b6-a5a7-d1f28e759bb0] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:28:01.273900 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-6a9f1ace-2af2-4314-86ff-298499fea6ea tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:28:01.274393 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-6a9f1ace-2af2-4314-86ff-298499fea6ea tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:28:01.274830 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-6a9f1ace-2af2-4314-86ff-298499fea6ea tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:28:01.275534 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-6a9f1ace-2af2-4314-86ff-298499fea6ea tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:28:01.276107 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-6a9f1ace-2af2-4314-86ff-298499fea6ea tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:28:01.276415 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-6a9f1ace-2af2-4314-86ff-298499fea6ea tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:28:01.408148 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-6a9f1ace-2af2-4314-86ff-298499fea6ea tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16778b0dd21d41eeaa6087b67931eef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba9bc456234ea6ade63d41a1624967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:28:01.416042 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-6a9f1ace-2af2-4314-86ff-298499fea6ea tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] 10.222.0.16 "GET /compute/v2.1/servers/1fd43154-badc-47b6-a5a7-d1f28e759bb0" status: 200 len: 1366 microversion: 2.1 time: 0.153297 Oct 31 19:28:01.416613 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 445/891] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:28:01 2022] GET /compute/v2.1/servers/1fd43154-badc-47b6-a5a7-d1f28e759bb0 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:28:02.104985 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-a856a732-9949-465a-97ac-604aeddec318 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:28:02.107188 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-a856a732-9949-465a-97ac-604aeddec318 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:28:02.113689 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-a856a732-9949-465a-97ac-604aeddec318 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:28:02.114144 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-a856a732-9949-465a-97ac-604aeddec318 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:28:02.114552 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-a856a732-9949-465a-97ac-604aeddec318 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:28:02.115248 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-a856a732-9949-465a-97ac-604aeddec318 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:28:02.115700 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-a856a732-9949-465a-97ac-604aeddec318 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:28:02.116121 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-a856a732-9949-465a-97ac-604aeddec318 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:28:02.147848 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-a856a732-9949-465a-97ac-604aeddec318 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.046761 Oct 31 19:28:02.149775 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 447/892] 10.222.0.16 () {60 vars in 1343 bytes} [Mon Oct 31 19:28:02 2022] GET /compute/v2.1/servers/3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:28:02.215145 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-153b78a2-f9b8-4c2e-b72d-1b254024cae3 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:28:02.215560 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-153b78a2-f9b8-4c2e-b72d-1b254024cae3 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:28:02.222005 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-153b78a2-f9b8-4c2e-b72d-1b254024cae3 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:28:02.222514 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-153b78a2-f9b8-4c2e-b72d-1b254024cae3 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:28:02.222948 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-153b78a2-f9b8-4c2e-b72d-1b254024cae3 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:28:02.223646 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-153b78a2-f9b8-4c2e-b72d-1b254024cae3 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:28:02.224111 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-153b78a2-f9b8-4c2e-b72d-1b254024cae3 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:28:02.224562 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-153b78a2-f9b8-4c2e-b72d-1b254024cae3 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:28:02.249951 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-153b78a2-f9b8-4c2e-b72d-1b254024cae3 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29] Going to try to terminate instance {{(pid=118727) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 19:28:02.256527 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [req-50540c16-6b6c-46a6-82f3-4ae995c452c1 req-85ea8268-e92f-4831-8995-6611f3a4e504 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fd43154-badc-47b6-a5a7-d1f28e759bb0", "name": "network-vif-plugged", "status": "completed", "tag": "03f69bfc-980f-40fa-86a8-15bddfdfdfd1"}]} {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:28:02.267415 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [req-50540c16-6b6c-46a6-82f3-4ae995c452c1 req-85ea8268-e92f-4831-8995-6611f3a4e504 service nova] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:28:02.267829 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [req-50540c16-6b6c-46a6-82f3-4ae995c452c1 req-85ea8268-e92f-4831-8995-6611f3a4e504 service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:28:02.268782 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [req-50540c16-6b6c-46a6-82f3-4ae995c452c1 req-85ea8268-e92f-4831-8995-6611f3a4e504 service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:28:02.281286 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.compute.server_external_events [req-50540c16-6b6c-46a6-82f3-4ae995c452c1 req-85ea8268-e92f-4831-8995-6611f3a4e504 service nova] Creating event network-vif-plugged:03f69bfc-980f-40fa-86a8-15bddfdfdfd1 for instance 1fd43154-badc-47b6-a5a7-d1f28e759bb0 on hv-cinder-86309 Oct 31 19:28:02.286635 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [req-50540c16-6b6c-46a6-82f3-4ae995c452c1 req-85ea8268-e92f-4831-8995-6611f3a4e504 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036798 Oct 31 19:28:02.287234 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 448/893] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 31 19:28:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 19:28:02.339703 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-153b78a2-f9b8-4c2e-b72d-1b254024cae3 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "DELETE /compute/v2.1/servers/3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29" status: 204 len: 0 microversion: 2.20 time: 0.128188 Oct 31 19:28:02.340380 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 446/894] 10.222.0.16 () {60 vars in 1280 bytes} [Mon Oct 31 19:28:02 2022] DELETE /compute/v2.1/servers/3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 31 19:28:02.349576 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-6430a1a7-da1d-4b22-a6be-049c2fdb4abd tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:28:02.350574 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-6430a1a7-da1d-4b22-a6be-049c2fdb4abd tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:28:02.356932 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-6430a1a7-da1d-4b22-a6be-049c2fdb4abd tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:28:02.357548 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-6430a1a7-da1d-4b22-a6be-049c2fdb4abd tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:28:02.358018 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-6430a1a7-da1d-4b22-a6be-049c2fdb4abd tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:28:02.359005 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-6430a1a7-da1d-4b22-a6be-049c2fdb4abd tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:28:02.359506 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-6430a1a7-da1d-4b22-a6be-049c2fdb4abd tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:28:02.360017 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-6430a1a7-da1d-4b22-a6be-049c2fdb4abd tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:28:02.440049 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-41e87a26-6833-4325-a2f1-96f4f22789b0 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:28:02.440782 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-41e87a26-6833-4325-a2f1-96f4f22789b0 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] [instance: 1fd43154-badc-47b6-a5a7-d1f28e759bb0] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:28:02.447077 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-41e87a26-6833-4325-a2f1-96f4f22789b0 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:28:02.447558 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-41e87a26-6833-4325-a2f1-96f4f22789b0 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:28:02.447991 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-41e87a26-6833-4325-a2f1-96f4f22789b0 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:28:02.448682 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-41e87a26-6833-4325-a2f1-96f4f22789b0 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:28:02.449132 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-41e87a26-6833-4325-a2f1-96f4f22789b0 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:28:02.449551 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-41e87a26-6833-4325-a2f1-96f4f22789b0 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:28:02.497654 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-6430a1a7-da1d-4b22-a6be-049c2fdb4abd tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:28:02.506416 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-6430a1a7-da1d-4b22-a6be-049c2fdb4abd tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:28:02.507873 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-6430a1a7-da1d-4b22-a6be-049c2fdb4abd tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:28:02.509037 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-6430a1a7-da1d-4b22-a6be-049c2fdb4abd tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29" status: 200 len: 1725 microversion: 2.20 time: 0.164072 Oct 31 19:28:02.509625 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 449/895] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 31 19:28:02 2022] GET /compute/v2.1/servers/3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29 => generated 1725 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 19:28:02.583866 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-41e87a26-6833-4325-a2f1-96f4f22789b0 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16778b0dd21d41eeaa6087b67931eef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba9bc456234ea6ade63d41a1624967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:28:02.591435 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-41e87a26-6833-4325-a2f1-96f4f22789b0 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] 10.222.0.16 "GET /compute/v2.1/servers/1fd43154-badc-47b6-a5a7-d1f28e759bb0" status: 200 len: 1366 microversion: 2.1 time: 0.155774 Oct 31 19:28:02.591993 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 447/896] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:28:02 2022] GET /compute/v2.1/servers/1fd43154-badc-47b6-a5a7-d1f28e759bb0 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 19:28:03.533518 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-567f0068-a610-4f36-94c3-0646b0b835cd tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:28:03.534748 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-567f0068-a610-4f36-94c3-0646b0b835cd tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:28:03.541330 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-567f0068-a610-4f36-94c3-0646b0b835cd tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:28:03.541842 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-567f0068-a610-4f36-94c3-0646b0b835cd tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:28:03.542274 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-567f0068-a610-4f36-94c3-0646b0b835cd tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:28:03.542955 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-567f0068-a610-4f36-94c3-0646b0b835cd tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:28:03.543400 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-567f0068-a610-4f36-94c3-0646b0b835cd tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:28:03.543816 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-567f0068-a610-4f36-94c3-0646b0b835cd tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:28:03.614507 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-3a231c55-06d6-47bf-b96d-97f1bc6bc4a2 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:28:03.615388 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-3a231c55-06d6-47bf-b96d-97f1bc6bc4a2 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] [instance: 1fd43154-badc-47b6-a5a7-d1f28e759bb0] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:28:03.618975 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG dbcounter [-] [118727] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=118727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:28:03.623860 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-3a231c55-06d6-47bf-b96d-97f1bc6bc4a2 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:28:03.624350 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-3a231c55-06d6-47bf-b96d-97f1bc6bc4a2 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:28:03.624828 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-3a231c55-06d6-47bf-b96d-97f1bc6bc4a2 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:28:03.625534 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-3a231c55-06d6-47bf-b96d-97f1bc6bc4a2 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:28:03.626015 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-3a231c55-06d6-47bf-b96d-97f1bc6bc4a2 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:28:03.626441 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-3a231c55-06d6-47bf-b96d-97f1bc6bc4a2 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:28:03.673720 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-567f0068-a610-4f36-94c3-0646b0b835cd tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:28:03.682293 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-567f0068-a610-4f36-94c3-0646b0b835cd tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:28:03.683743 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-567f0068-a610-4f36-94c3-0646b0b835cd tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:28:03.684891 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-567f0068-a610-4f36-94c3-0646b0b835cd tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29" status: 200 len: 1725 microversion: 2.20 time: 0.155292 Oct 31 19:28:03.685452 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 450/897] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 31 19:28:03 2022] GET /compute/v2.1/servers/3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29 => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 19:28:03.759604 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-3a231c55-06d6-47bf-b96d-97f1bc6bc4a2 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16778b0dd21d41eeaa6087b67931eef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba9bc456234ea6ade63d41a1624967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:28:03.767134 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-3a231c55-06d6-47bf-b96d-97f1bc6bc4a2 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] 10.222.0.16 "GET /compute/v2.1/servers/1fd43154-badc-47b6-a5a7-d1f28e759bb0" status: 200 len: 1366 microversion: 2.1 time: 0.156492 Oct 31 19:28:03.767699 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 448/898] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:28:03 2022] GET /compute/v2.1/servers/1fd43154-badc-47b6-a5a7-d1f28e759bb0 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 19:28:04.657017 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [req-083ebdaa-a8d9-489a-80b2-1622cf247756 req-35e35409-108d-4bd9-b149-72d8654b40ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29", "name": "network-vif-deleted", "tag": "0e51264f-300d-49b6-9f03-c22ed061b801"}]} {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:28:04.667762 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [req-083ebdaa-a8d9-489a-80b2-1622cf247756 req-35e35409-108d-4bd9-b149-72d8654b40ab service nova] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:28:04.668236 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [req-083ebdaa-a8d9-489a-80b2-1622cf247756 req-35e35409-108d-4bd9-b149-72d8654b40ab service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:28:04.668657 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [req-083ebdaa-a8d9-489a-80b2-1622cf247756 req-35e35409-108d-4bd9-b149-72d8654b40ab service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:28:04.681445 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.compute.server_external_events [req-083ebdaa-a8d9-489a-80b2-1622cf247756 req-35e35409-108d-4bd9-b149-72d8654b40ab service nova] Creating event network-vif-deleted:0e51264f-300d-49b6-9f03-c22ed061b801 for instance 3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29 on hv-cinder-86309 Oct 31 19:28:04.686393 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [req-083ebdaa-a8d9-489a-80b2-1622cf247756 req-35e35409-108d-4bd9-b149-72d8654b40ab service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033247 Oct 31 19:28:04.687022 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 451/899] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 31 19:28:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:28:04.713440 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-57b99d6a-35dd-48e1-ade6-8068cea24354 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:28:04.714076 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-57b99d6a-35dd-48e1-ade6-8068cea24354 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:28:04.721834 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-57b99d6a-35dd-48e1-ade6-8068cea24354 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:28:04.722864 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-57b99d6a-35dd-48e1-ade6-8068cea24354 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:28:04.723485 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-57b99d6a-35dd-48e1-ade6-8068cea24354 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:28:04.724417 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-57b99d6a-35dd-48e1-ade6-8068cea24354 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:28:04.725664 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-57b99d6a-35dd-48e1-ade6-8068cea24354 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:28:04.726445 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-57b99d6a-35dd-48e1-ade6-8068cea24354 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:28:04.797423 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-47bbe84e-ad8f-4ffc-8669-6716fce538c5 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:28:04.801127 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-47bbe84e-ad8f-4ffc-8669-6716fce538c5 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] [instance: 1fd43154-badc-47b6-a5a7-d1f28e759bb0] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:28:04.802714 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-57b99d6a-35dd-48e1-ade6-8068cea24354 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:28:04.808195 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-47bbe84e-ad8f-4ffc-8669-6716fce538c5 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:28:04.808969 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-47bbe84e-ad8f-4ffc-8669-6716fce538c5 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:28:04.809600 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-47bbe84e-ad8f-4ffc-8669-6716fce538c5 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:28:04.810837 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-47bbe84e-ad8f-4ffc-8669-6716fce538c5 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:28:04.811656 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-47bbe84e-ad8f-4ffc-8669-6716fce538c5 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:28:04.812010 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-57b99d6a-35dd-48e1-ade6-8068cea24354 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:28:04.812513 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-47bbe84e-ad8f-4ffc-8669-6716fce538c5 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:28:04.818337 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-57b99d6a-35dd-48e1-ade6-8068cea24354 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '295bd78a5b204dc2a2d70a2610c6ab3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b4e580885f431b9ccb8aa409fdd454', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:28:04.820014 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-57b99d6a-35dd-48e1-ade6-8068cea24354 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29" status: 200 len: 1657 microversion: 2.20 time: 0.111145 Oct 31 19:28:04.820605 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 449/900] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 31 19:28:04 2022] GET /compute/v2.1/servers/3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29 => generated 1657 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 19:28:05.001126 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-47bbe84e-ad8f-4ffc-8669-6716fce538c5 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16778b0dd21d41eeaa6087b67931eef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba9bc456234ea6ade63d41a1624967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:28:05.009334 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-47bbe84e-ad8f-4ffc-8669-6716fce538c5 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] 10.222.0.16 "GET /compute/v2.1/servers/1fd43154-badc-47b6-a5a7-d1f28e759bb0" status: 200 len: 1556 microversion: 2.1 time: 0.222024 Oct 31 19:28:05.017796 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 452/901] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:28:04 2022] GET /compute/v2.1/servers/1fd43154-badc-47b6-a5a7-d1f28e759bb0 => generated 1556 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 19:28:05.033693 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-938e5dac-f7b5-450e-974d-eccc7cc4cb66 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:28:05.034368 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-938e5dac-f7b5-450e-974d-eccc7cc4cb66 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] [instance: 1fd43154-badc-47b6-a5a7-d1f28e759bb0] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:28:05.041181 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-938e5dac-f7b5-450e-974d-eccc7cc4cb66 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:28:05.042010 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-938e5dac-f7b5-450e-974d-eccc7cc4cb66 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:28:05.042615 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-938e5dac-f7b5-450e-974d-eccc7cc4cb66 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:28:05.043475 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-938e5dac-f7b5-450e-974d-eccc7cc4cb66 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:28:05.044080 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-938e5dac-f7b5-450e-974d-eccc7cc4cb66 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:28:05.044684 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-938e5dac-f7b5-450e-974d-eccc7cc4cb66 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:28:05.131511 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-938e5dac-f7b5-450e-974d-eccc7cc4cb66 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] 10.222.0.16 "GET /compute/v2.1/servers/1fd43154-badc-47b6-a5a7-d1f28e759bb0/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.101864 Oct 31 19:28:05.132128 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 450/902] 10.222.0.16 () {58 vars in 1275 bytes} [Mon Oct 31 19:28:05 2022] GET /compute/v2.1/servers/1fd43154-badc-47b6-a5a7-d1f28e759bb0/os-interface => generated 285 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:28:05.845493 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-412a10ad-2e89-4dd6-a44e-eb3fc21cb1d2 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:28:05.846249 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-412a10ad-2e89-4dd6-a44e-eb3fc21cb1d2 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:28:05.849030 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG dbcounter [-] [118726] Writing DB stats nova_cell0:SELECT=2 {{(pid=118726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:28:05.849720 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG dbcounter [-] [118726] Writing DB stats nova_cell0:SELECT=6 {{(pid=118726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:28:05.856954 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-412a10ad-2e89-4dd6-a44e-eb3fc21cb1d2 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:28:05.857592 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-412a10ad-2e89-4dd6-a44e-eb3fc21cb1d2 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:28:05.858068 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-412a10ad-2e89-4dd6-a44e-eb3fc21cb1d2 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:28:05.858756 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-412a10ad-2e89-4dd6-a44e-eb3fc21cb1d2 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:28:05.859207 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-412a10ad-2e89-4dd6-a44e-eb3fc21cb1d2 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:28:05.859629 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-412a10ad-2e89-4dd6-a44e-eb3fc21cb1d2 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:28:05.880800 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.wsgi [None req-412a10ad-2e89-4dd6-a44e-eb3fc21cb1d2 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] HTTP exception thrown: Instance 3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29 could not be found. Oct 31 19:28:05.883240 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-412a10ad-2e89-4dd6-a44e-eb3fc21cb1d2 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Request method failure captured: Oct 31 19:28:05.883240 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: request: GET /compute/v2.1/servers/3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29 HTTP/1.1 Oct 31 19:28:05.883240 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: Accept: application/json Oct 31 19:28:05.883240 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: Accept-Encoding: identity Oct 31 19:28:05.883240 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: Connection: close Oct 31 19:28:05.883240 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: Content-Length: 0 Oct 31 19:28:05.883240 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: Content-Type: application/json Oct 31 19:28:05.883240 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: Host: 10.222.0.16 Oct 31 19:28:05.883240 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: Openstack-System-Scope: None Oct 31 19:28:05.883240 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: User-Agent: python-urllib3/1.26.12 Oct 31 19:28:05.883240 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Auth-Token: gAAAAABjYCAJIq6e9_SW2_V-qMTB1CWXdLQEgHamX_tNcPcsVde7myuHRMwkZjFpVtUC_Htjp6Wvjw70PhiYlINVeW2iZUvQwiOYS0SkYm9JroGPzRAKS0UOhmKgfWb4f11FSO_SKdkvUNRRVZqUq_9fz0YsFyU6dqQ-3DxHvhHc7yuBCQxwDEw Oct 31 19:28:05.883240 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Domain-Id: None Oct 31 19:28:05.883240 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Domain-Name: None Oct 31 19:28:05.883240 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Identity-Status: Confirmed Oct 31 19:28:05.883240 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Is-Admin-Project: True Oct 31 19:28:05.883240 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Openstack-Nova-Api-Version: 2.20 Oct 31 19:28:05.883240 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Project-Domain-Id: default Oct 31 19:28:05.883240 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Project-Domain-Name: Default Oct 31 19:28:05.883240 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Project-Id: 06b4e580885f431b9ccb8aa409fdd454 Oct 31 19:28:05.883240 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1845869762 Oct 31 19:28:05.883240 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Role: member,reader Oct 31 19:28:05.883240 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Roles: member,reader Oct 31 19:28:05.884761 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/06b4e580885f431b9ccb8aa409fdd454"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_06b4e580885f431b9ccb8aa409fdd454", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/06b4e580885f431b9ccb8aa409fdd454"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/06b4e580885f431b9ccb8aa409fdd454"}]}] Oct 31 19:28:05.884761 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1845869762 Oct 31 19:28:05.884761 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Tenant-Id: 06b4e580885f431b9ccb8aa409fdd454 Oct 31 19:28:05.884761 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1845869762 Oct 31 19:28:05.884761 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-User: tempest-AttachVolumeShelveTestJSON-1845869762-project Oct 31 19:28:05.884761 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-User-Domain-Id: default Oct 31 19:28:05.884761 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-User-Domain-Name: Default Oct 31 19:28:05.884761 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-User-Id: 295bd78a5b204dc2a2d70a2610c6ab3e Oct 31 19:28:05.884761 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1845869762-project Oct 31 19:28:05.884761 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: method: > Oct 31 19:28:05.884761 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: exception: Instance 3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29 could not be found. Oct 31 19:28:05.884761 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: action_args: {'id': '3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29'} Oct 31 19:28:05.885551 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 19:28:05.885551 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:28:05.885551 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 19:28:05.885551 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 19:28:05.885551 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 19:28:05.885551 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 19:28:05.885551 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 19:28:05.885551 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 19:28:05.885551 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 19:28:05.885551 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 19:28:05.885551 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29 could not be found. Oct 31 19:28:05.885551 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Oct 31 19:28:05.885551 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 19:28:05.885551 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Oct 31 19:28:05.885551 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:28:05.885551 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 19:28:05.885551 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 19:28:05.885551 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 19:28:05.885551 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 19:28:05.885551 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 19:28:05.886903 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 19:28:05.886903 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 19:28:05.886903 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 19:28:05.886903 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 19:28:05.886903 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 19:28:05.886903 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 19:28:05.886903 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 19:28:05.886903 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29 could not be found. Oct 31 19:28:05.886903 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Oct 31 19:28:05.886903 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 19:28:05.886903 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Oct 31 19:28:05.886903 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:28:05.886903 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 19:28:05.886903 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 19:28:05.886903 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 19:28:05.886903 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 19:28:05.886903 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29 could not be found. Oct 31 19:28:05.886903 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Oct 31 19:28:05.888115 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-412a10ad-2e89-4dd6-a44e-eb3fc21cb1d2 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Returning 404 to user: Instance 3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29 could not be found. {{(pid=118726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 19:28:05.888115 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-412a10ad-2e89-4dd6-a44e-eb3fc21cb1d2 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29" status: 404 len: 111 microversion: 2.20 time: 0.044452 Oct 31 19:28:05.888115 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 453/903] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 31 19:28:05 2022] GET /compute/v2.1/servers/3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 31 19:28:05.892106 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG dbcounter [-] [118727] Writing DB stats nova_cell0:SELECT=6 {{(pid=118727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:28:05.898193 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-c58b9c6a-8153-46fd-8edc-f46e7139271d tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '.version_select at 0x7f34f58c9550>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:28:05.917822 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-c58b9c6a-8153-46fd-8edc-f46e7139271d tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1720043642" status: 204 len: 0 microversion: 2.20 time: 0.026896 Oct 31 19:28:05.918385 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 451/904] 10.222.0.16 () {60 vars in 1262 bytes} [Mon Oct 31 19:28:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1720043642 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 31 19:28:06.397411 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [req-7e7b42f5-8264-41ad-810f-2a648d09e682 req-56d72cdf-547a-4ba3-b10e-7f1972f7914d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1fd43154-badc-47b6-a5a7-d1f28e759bb0", "tag": "03f69bfc-980f-40fa-86a8-15bddfdfdfd1"}]} {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:28:06.407971 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [req-7e7b42f5-8264-41ad-810f-2a648d09e682 req-56d72cdf-547a-4ba3-b10e-7f1972f7914d service nova] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:28:06.409807 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [req-7e7b42f5-8264-41ad-810f-2a648d09e682 req-56d72cdf-547a-4ba3-b10e-7f1972f7914d service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:28:06.410554 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [req-7e7b42f5-8264-41ad-810f-2a648d09e682 req-56d72cdf-547a-4ba3-b10e-7f1972f7914d service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:28:06.424623 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.compute.server_external_events [req-7e7b42f5-8264-41ad-810f-2a648d09e682 req-56d72cdf-547a-4ba3-b10e-7f1972f7914d service nova] Creating event network-changed:03f69bfc-980f-40fa-86a8-15bddfdfdfd1 for instance 1fd43154-badc-47b6-a5a7-d1f28e759bb0 on hv-cinder-86309 Oct 31 19:28:06.430605 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [req-7e7b42f5-8264-41ad-810f-2a648d09e682 req-56d72cdf-547a-4ba3-b10e-7f1972f7914d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037346 Oct 31 19:28:06.432440 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 454/905] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 31 19:28:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:28:08.335400 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-bd233777-9f08-470a-99a3-e7481ce2ebd4 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:28:08.335967 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-bd233777-9f08-470a-99a3-e7481ce2ebd4 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:28:08.342954 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-bd233777-9f08-470a-99a3-e7481ce2ebd4 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:28:08.343434 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-bd233777-9f08-470a-99a3-e7481ce2ebd4 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:28:08.343868 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-bd233777-9f08-470a-99a3-e7481ce2ebd4 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:28:08.344550 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-bd233777-9f08-470a-99a3-e7481ce2ebd4 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:28:08.345007 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-bd233777-9f08-470a-99a3-e7481ce2ebd4 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:28:08.345429 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-bd233777-9f08-470a-99a3-e7481ce2ebd4 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:28:08.358932 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.wsgi [None req-bd233777-9f08-470a-99a3-e7481ce2ebd4 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] HTTP exception thrown: Instance 3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29 could not be found. Oct 31 19:28:08.360556 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-bd233777-9f08-470a-99a3-e7481ce2ebd4 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Request method failure captured: Oct 31 19:28:08.360556 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: request: DELETE /compute/v2.1/servers/3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29 HTTP/1.1 Oct 31 19:28:08.360556 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Accept: application/json Oct 31 19:28:08.360556 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Accept-Encoding: identity Oct 31 19:28:08.360556 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Connection: close Oct 31 19:28:08.360556 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Content-Length: 0 Oct 31 19:28:08.360556 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Content-Type: application/json Oct 31 19:28:08.360556 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Host: 10.222.0.16 Oct 31 19:28:08.360556 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Openstack-System-Scope: None Oct 31 19:28:08.360556 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: User-Agent: python-urllib3/1.26.12 Oct 31 19:28:08.360556 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Auth-Token: gAAAAABjYCAJIq6e9_SW2_V-qMTB1CWXdLQEgHamX_tNcPcsVde7myuHRMwkZjFpVtUC_Htjp6Wvjw70PhiYlINVeW2iZUvQwiOYS0SkYm9JroGPzRAKS0UOhmKgfWb4f11FSO_SKdkvUNRRVZqUq_9fz0YsFyU6dqQ-3DxHvhHc7yuBCQxwDEw Oct 31 19:28:08.360556 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Domain-Id: None Oct 31 19:28:08.360556 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Domain-Name: None Oct 31 19:28:08.360556 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Identity-Status: Confirmed Oct 31 19:28:08.360556 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Is-Admin-Project: True Oct 31 19:28:08.360556 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Openstack-Nova-Api-Version: 2.20 Oct 31 19:28:08.360556 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Project-Domain-Id: default Oct 31 19:28:08.360556 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Project-Domain-Name: Default Oct 31 19:28:08.360556 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Project-Id: 06b4e580885f431b9ccb8aa409fdd454 Oct 31 19:28:08.360556 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1845869762 Oct 31 19:28:08.360556 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Role: member,reader Oct 31 19:28:08.360556 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Roles: member,reader Oct 31 19:28:08.362281 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/06b4e580885f431b9ccb8aa409fdd454"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_06b4e580885f431b9ccb8aa409fdd454", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/06b4e580885f431b9ccb8aa409fdd454"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/06b4e580885f431b9ccb8aa409fdd454"}]}] Oct 31 19:28:08.362281 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1845869762 Oct 31 19:28:08.362281 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Tenant-Id: 06b4e580885f431b9ccb8aa409fdd454 Oct 31 19:28:08.362281 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1845869762 Oct 31 19:28:08.362281 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User: tempest-AttachVolumeShelveTestJSON-1845869762-project Oct 31 19:28:08.362281 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User-Domain-Id: default Oct 31 19:28:08.362281 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User-Domain-Name: Default Oct 31 19:28:08.362281 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User-Id: 295bd78a5b204dc2a2d70a2610c6ab3e Oct 31 19:28:08.362281 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1845869762-project Oct 31 19:28:08.362281 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: method: > Oct 31 19:28:08.362281 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: exception: Instance 3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29 could not be found. Oct 31 19:28:08.362281 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: action_args: {'id': '3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29'} Oct 31 19:28:08.363320 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 19:28:08.363320 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:28:08.363320 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 19:28:08.363320 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 19:28:08.363320 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 19:28:08.363320 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 19:28:08.363320 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 19:28:08.363320 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 19:28:08.363320 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 19:28:08.363320 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 19:28:08.363320 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29 could not be found. Oct 31 19:28:08.363320 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:28:08.363320 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 19:28:08.363320 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:28:08.363320 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:28:08.363320 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 19:28:08.363320 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 19:28:08.363320 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 19:28:08.363320 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 19:28:08.363320 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 19:28:08.364842 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 19:28:08.364842 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 19:28:08.364842 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 19:28:08.364842 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 19:28:08.364842 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 19:28:08.364842 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 19:28:08.364842 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 19:28:08.364842 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 19:28:08.364842 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 19:28:08.364842 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29 could not be found. Oct 31 19:28:08.364842 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:28:08.364842 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 19:28:08.364842 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:28:08.364842 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:28:08.364842 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 19:28:08.364842 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 19:28:08.364842 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 19:28:08.364842 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 19:28:08.364842 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29 could not be found. Oct 31 19:28:08.364842 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:28:08.366445 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-bd233777-9f08-470a-99a3-e7481ce2ebd4 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Returning 404 to user: Instance 3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29 could not be found. {{(pid=118727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 19:28:08.366445 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-bd233777-9f08-470a-99a3-e7481ce2ebd4 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "DELETE /compute/v2.1/servers/3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29" status: 404 len: 111 microversion: 2.20 time: 0.030472 Oct 31 19:28:08.366445 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 452/906] 10.222.0.16 () {60 vars in 1280 bytes} [Mon Oct 31 19:28:08 2022] DELETE /compute/v2.1/servers/3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 31 19:28:08.371521 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-38691377-718a-471d-98b2-f627d4f7292d tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:28:08.372245 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-38691377-718a-471d-98b2-f627d4f7292d tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:28:08.378820 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-38691377-718a-471d-98b2-f627d4f7292d tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:28:08.379293 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-38691377-718a-471d-98b2-f627d4f7292d tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:28:08.379719 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-38691377-718a-471d-98b2-f627d4f7292d tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:28:08.380412 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-38691377-718a-471d-98b2-f627d4f7292d tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:28:08.380841 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-38691377-718a-471d-98b2-f627d4f7292d tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:28:08.381265 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-38691377-718a-471d-98b2-f627d4f7292d tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:28:08.394795 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.wsgi [None req-38691377-718a-471d-98b2-f627d4f7292d tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] HTTP exception thrown: Instance 3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29 could not be found. Oct 31 19:28:08.396401 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-38691377-718a-471d-98b2-f627d4f7292d tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Request method failure captured: Oct 31 19:28:08.396401 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: request: GET /compute/v2.1/servers/3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29 HTTP/1.1 Oct 31 19:28:08.396401 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: Accept: application/json Oct 31 19:28:08.396401 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: Accept-Encoding: identity Oct 31 19:28:08.396401 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: Connection: close Oct 31 19:28:08.396401 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: Content-Length: 0 Oct 31 19:28:08.396401 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: Content-Type: application/json Oct 31 19:28:08.396401 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: Host: 10.222.0.16 Oct 31 19:28:08.396401 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: Openstack-System-Scope: None Oct 31 19:28:08.396401 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: User-Agent: python-urllib3/1.26.12 Oct 31 19:28:08.396401 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Auth-Token: gAAAAABjYCAJIq6e9_SW2_V-qMTB1CWXdLQEgHamX_tNcPcsVde7myuHRMwkZjFpVtUC_Htjp6Wvjw70PhiYlINVeW2iZUvQwiOYS0SkYm9JroGPzRAKS0UOhmKgfWb4f11FSO_SKdkvUNRRVZqUq_9fz0YsFyU6dqQ-3DxHvhHc7yuBCQxwDEw Oct 31 19:28:08.396401 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Domain-Id: None Oct 31 19:28:08.396401 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Domain-Name: None Oct 31 19:28:08.396401 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Identity-Status: Confirmed Oct 31 19:28:08.396401 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Is-Admin-Project: True Oct 31 19:28:08.396401 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Openstack-Nova-Api-Version: 2.20 Oct 31 19:28:08.396401 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Project-Domain-Id: default Oct 31 19:28:08.396401 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Project-Domain-Name: Default Oct 31 19:28:08.396401 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Project-Id: 06b4e580885f431b9ccb8aa409fdd454 Oct 31 19:28:08.396401 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1845869762 Oct 31 19:28:08.396401 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Role: member,reader Oct 31 19:28:08.396401 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Roles: member,reader Oct 31 19:28:08.398139 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/06b4e580885f431b9ccb8aa409fdd454"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_06b4e580885f431b9ccb8aa409fdd454", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/06b4e580885f431b9ccb8aa409fdd454"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/06b4e580885f431b9ccb8aa409fdd454"}]}] Oct 31 19:28:08.398139 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1845869762 Oct 31 19:28:08.398139 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Tenant-Id: 06b4e580885f431b9ccb8aa409fdd454 Oct 31 19:28:08.398139 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1845869762 Oct 31 19:28:08.398139 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-User: tempest-AttachVolumeShelveTestJSON-1845869762-project Oct 31 19:28:08.398139 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-User-Domain-Id: default Oct 31 19:28:08.398139 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-User-Domain-Name: Default Oct 31 19:28:08.398139 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-User-Id: 295bd78a5b204dc2a2d70a2610c6ab3e Oct 31 19:28:08.398139 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1845869762-project Oct 31 19:28:08.398139 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: method: > Oct 31 19:28:08.398139 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: exception: Instance 3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29 could not be found. Oct 31 19:28:08.398139 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: action_args: {'id': '3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29'} Oct 31 19:28:08.399620 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 19:28:08.399620 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:28:08.399620 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 19:28:08.399620 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 19:28:08.399620 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 19:28:08.399620 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 19:28:08.399620 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 19:28:08.399620 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 19:28:08.399620 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 19:28:08.399620 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 19:28:08.399620 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29 could not be found. Oct 31 19:28:08.399620 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Oct 31 19:28:08.399620 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 19:28:08.399620 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Oct 31 19:28:08.399620 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:28:08.399620 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 19:28:08.399620 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 19:28:08.399620 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 19:28:08.399620 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 19:28:08.399620 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 19:28:08.401327 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 19:28:08.401327 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 19:28:08.401327 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 19:28:08.401327 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 19:28:08.401327 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 19:28:08.401327 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 19:28:08.401327 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 19:28:08.401327 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29 could not be found. Oct 31 19:28:08.401327 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Oct 31 19:28:08.401327 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 19:28:08.401327 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Oct 31 19:28:08.401327 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:28:08.401327 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 19:28:08.401327 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 19:28:08.401327 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 19:28:08.401327 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 19:28:08.401327 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29 could not be found. Oct 31 19:28:08.401327 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Oct 31 19:28:08.402666 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-38691377-718a-471d-98b2-f627d4f7292d tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Returning 404 to user: Instance 3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29 could not be found. {{(pid=118726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 19:28:08.402666 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-38691377-718a-471d-98b2-f627d4f7292d tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29" status: 404 len: 111 microversion: 2.20 time: 0.030968 Oct 31 19:28:08.402666 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 455/907] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 31 19:28:08 2022] GET /compute/v2.1/servers/3e9c3f6b-9bc2-46b0-a9ca-99f32149fb29 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 31 19:28:09.537688 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-4378ebd4-93c4-4dd9-9724-eee2179bcd96 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:28:09.538181 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-4378ebd4-93c4-4dd9-9724-eee2179bcd96 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 24ad6e3e-6043-4eff-afb4-0c6039e825fa] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:28:09.544675 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-4378ebd4-93c4-4dd9-9724-eee2179bcd96 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:28:09.545145 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-4378ebd4-93c4-4dd9-9724-eee2179bcd96 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:28:09.545568 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-4378ebd4-93c4-4dd9-9724-eee2179bcd96 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:28:09.546270 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-4378ebd4-93c4-4dd9-9724-eee2179bcd96 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:28:09.546718 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-4378ebd4-93c4-4dd9-9724-eee2179bcd96 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:28:09.547132 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-4378ebd4-93c4-4dd9-9724-eee2179bcd96 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:28:09.560559 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.wsgi [None req-4378ebd4-93c4-4dd9-9724-eee2179bcd96 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] HTTP exception thrown: Instance 24ad6e3e-6043-4eff-afb4-0c6039e825fa could not be found. Oct 31 19:28:09.562094 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-4378ebd4-93c4-4dd9-9724-eee2179bcd96 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Request method failure captured: Oct 31 19:28:09.562094 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: request: DELETE /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa HTTP/1.1 Oct 31 19:28:09.562094 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Accept: application/json Oct 31 19:28:09.562094 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Accept-Encoding: identity Oct 31 19:28:09.562094 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Connection: close Oct 31 19:28:09.562094 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Content-Length: 0 Oct 31 19:28:09.562094 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Content-Type: application/json Oct 31 19:28:09.562094 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Host: 10.222.0.16 Oct 31 19:28:09.562094 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Openstack-System-Scope: None Oct 31 19:28:09.562094 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: User-Agent: python-urllib3/1.26.12 Oct 31 19:28:09.562094 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Auth-Token: gAAAAABjYCAJIq6e9_SW2_V-qMTB1CWXdLQEgHamX_tNcPcsVde7myuHRMwkZjFpVtUC_Htjp6Wvjw70PhiYlINVeW2iZUvQwiOYS0SkYm9JroGPzRAKS0UOhmKgfWb4f11FSO_SKdkvUNRRVZqUq_9fz0YsFyU6dqQ-3DxHvhHc7yuBCQxwDEw Oct 31 19:28:09.562094 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Domain-Id: None Oct 31 19:28:09.562094 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Domain-Name: None Oct 31 19:28:09.562094 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Identity-Status: Confirmed Oct 31 19:28:09.562094 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Is-Admin-Project: True Oct 31 19:28:09.562094 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Openstack-Nova-Api-Version: 2.20 Oct 31 19:28:09.562094 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Project-Domain-Id: default Oct 31 19:28:09.562094 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Project-Domain-Name: Default Oct 31 19:28:09.562094 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Project-Id: 06b4e580885f431b9ccb8aa409fdd454 Oct 31 19:28:09.562094 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1845869762 Oct 31 19:28:09.562094 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Role: member,reader Oct 31 19:28:09.562094 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Roles: member,reader Oct 31 19:28:09.563768 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/06b4e580885f431b9ccb8aa409fdd454"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_06b4e580885f431b9ccb8aa409fdd454", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/06b4e580885f431b9ccb8aa409fdd454"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/06b4e580885f431b9ccb8aa409fdd454"}]}] Oct 31 19:28:09.563768 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1845869762 Oct 31 19:28:09.563768 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Tenant-Id: 06b4e580885f431b9ccb8aa409fdd454 Oct 31 19:28:09.563768 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1845869762 Oct 31 19:28:09.563768 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User: tempest-AttachVolumeShelveTestJSON-1845869762-project Oct 31 19:28:09.563768 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User-Domain-Id: default Oct 31 19:28:09.563768 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User-Domain-Name: Default Oct 31 19:28:09.563768 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User-Id: 295bd78a5b204dc2a2d70a2610c6ab3e Oct 31 19:28:09.563768 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1845869762-project Oct 31 19:28:09.563768 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: method: > Oct 31 19:28:09.563768 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: exception: Instance 24ad6e3e-6043-4eff-afb4-0c6039e825fa could not be found. Oct 31 19:28:09.563768 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: action_args: {'id': '24ad6e3e-6043-4eff-afb4-0c6039e825fa'} Oct 31 19:28:09.564760 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 19:28:09.564760 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:28:09.564760 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 19:28:09.564760 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 19:28:09.564760 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 19:28:09.564760 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 19:28:09.564760 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 19:28:09.564760 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 19:28:09.564760 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 19:28:09.564760 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 19:28:09.564760 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24ad6e3e-6043-4eff-afb4-0c6039e825fa could not be found. Oct 31 19:28:09.564760 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:28:09.564760 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 19:28:09.564760 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:28:09.564760 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:28:09.564760 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 19:28:09.564760 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 19:28:09.564760 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 19:28:09.564760 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 19:28:09.564760 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 19:28:09.566922 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 19:28:09.566922 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 19:28:09.566922 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 19:28:09.566922 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 19:28:09.566922 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 19:28:09.566922 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 19:28:09.566922 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 19:28:09.566922 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 19:28:09.566922 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 19:28:09.566922 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24ad6e3e-6043-4eff-afb4-0c6039e825fa could not be found. Oct 31 19:28:09.566922 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:28:09.566922 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 19:28:09.566922 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:28:09.566922 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:28:09.566922 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 19:28:09.566922 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 19:28:09.566922 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 19:28:09.566922 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 19:28:09.566922 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24ad6e3e-6043-4eff-afb4-0c6039e825fa could not be found. Oct 31 19:28:09.566922 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:28:09.568356 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-4378ebd4-93c4-4dd9-9724-eee2179bcd96 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Returning 404 to user: Instance 24ad6e3e-6043-4eff-afb4-0c6039e825fa could not be found. {{(pid=118727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 19:28:09.568356 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-4378ebd4-93c4-4dd9-9724-eee2179bcd96 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "DELETE /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa" status: 404 len: 111 microversion: 2.20 time: 0.029619 Oct 31 19:28:09.568356 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 453/908] 10.222.0.16 () {60 vars in 1280 bytes} [Mon Oct 31 19:28:09 2022] DELETE /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 31 19:28:09.572311 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-b410cd4b-4a9f-4422-a457-519fa8eb1fb7 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:28:09.572918 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-b410cd4b-4a9f-4422-a457-519fa8eb1fb7 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] [instance: 24ad6e3e-6043-4eff-afb4-0c6039e825fa] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:28:09.579232 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-b410cd4b-4a9f-4422-a457-519fa8eb1fb7 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:28:09.579711 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-b410cd4b-4a9f-4422-a457-519fa8eb1fb7 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:28:09.580146 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-b410cd4b-4a9f-4422-a457-519fa8eb1fb7 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:28:09.580831 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-b410cd4b-4a9f-4422-a457-519fa8eb1fb7 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:28:09.581286 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-b410cd4b-4a9f-4422-a457-519fa8eb1fb7 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:28:09.581737 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-b410cd4b-4a9f-4422-a457-519fa8eb1fb7 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:28:09.594806 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.wsgi [None req-b410cd4b-4a9f-4422-a457-519fa8eb1fb7 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] HTTP exception thrown: Instance 24ad6e3e-6043-4eff-afb4-0c6039e825fa could not be found. Oct 31 19:28:09.596300 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-b410cd4b-4a9f-4422-a457-519fa8eb1fb7 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Request method failure captured: Oct 31 19:28:09.596300 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: request: GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa HTTP/1.1 Oct 31 19:28:09.596300 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: Accept: application/json Oct 31 19:28:09.596300 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: Accept-Encoding: identity Oct 31 19:28:09.596300 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: Connection: close Oct 31 19:28:09.596300 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: Content-Length: 0 Oct 31 19:28:09.596300 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: Content-Type: application/json Oct 31 19:28:09.596300 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: Host: 10.222.0.16 Oct 31 19:28:09.596300 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: Openstack-System-Scope: None Oct 31 19:28:09.596300 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: User-Agent: python-urllib3/1.26.12 Oct 31 19:28:09.596300 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Auth-Token: gAAAAABjYCAJIq6e9_SW2_V-qMTB1CWXdLQEgHamX_tNcPcsVde7myuHRMwkZjFpVtUC_Htjp6Wvjw70PhiYlINVeW2iZUvQwiOYS0SkYm9JroGPzRAKS0UOhmKgfWb4f11FSO_SKdkvUNRRVZqUq_9fz0YsFyU6dqQ-3DxHvhHc7yuBCQxwDEw Oct 31 19:28:09.596300 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Domain-Id: None Oct 31 19:28:09.596300 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Domain-Name: None Oct 31 19:28:09.596300 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Identity-Status: Confirmed Oct 31 19:28:09.596300 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Is-Admin-Project: True Oct 31 19:28:09.596300 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Openstack-Nova-Api-Version: 2.20 Oct 31 19:28:09.596300 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Project-Domain-Id: default Oct 31 19:28:09.596300 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Project-Domain-Name: Default Oct 31 19:28:09.596300 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Project-Id: 06b4e580885f431b9ccb8aa409fdd454 Oct 31 19:28:09.596300 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1845869762 Oct 31 19:28:09.596300 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Role: member,reader Oct 31 19:28:09.596300 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Roles: member,reader Oct 31 19:28:09.597953 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/06b4e580885f431b9ccb8aa409fdd454"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_06b4e580885f431b9ccb8aa409fdd454", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/06b4e580885f431b9ccb8aa409fdd454"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/06b4e580885f431b9ccb8aa409fdd454"}]}] Oct 31 19:28:09.597953 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1845869762 Oct 31 19:28:09.597953 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Tenant-Id: 06b4e580885f431b9ccb8aa409fdd454 Oct 31 19:28:09.597953 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1845869762 Oct 31 19:28:09.597953 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-User: tempest-AttachVolumeShelveTestJSON-1845869762-project Oct 31 19:28:09.597953 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-User-Domain-Id: default Oct 31 19:28:09.597953 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-User-Domain-Name: Default Oct 31 19:28:09.597953 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-User-Id: 295bd78a5b204dc2a2d70a2610c6ab3e Oct 31 19:28:09.597953 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1845869762-project Oct 31 19:28:09.597953 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: method: > Oct 31 19:28:09.597953 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: exception: Instance 24ad6e3e-6043-4eff-afb4-0c6039e825fa could not be found. Oct 31 19:28:09.597953 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: action_args: {'id': '24ad6e3e-6043-4eff-afb4-0c6039e825fa'} Oct 31 19:28:09.598846 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 19:28:09.598846 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:28:09.598846 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 19:28:09.598846 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 19:28:09.598846 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 19:28:09.598846 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 19:28:09.598846 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 19:28:09.598846 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 19:28:09.598846 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 19:28:09.598846 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 19:28:09.598846 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24ad6e3e-6043-4eff-afb4-0c6039e825fa could not be found. Oct 31 19:28:09.598846 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Oct 31 19:28:09.598846 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 19:28:09.598846 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Oct 31 19:28:09.598846 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:28:09.598846 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 19:28:09.598846 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 19:28:09.598846 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 19:28:09.598846 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 19:28:09.598846 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 19:28:09.600362 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 19:28:09.600362 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 19:28:09.600362 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 19:28:09.600362 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 19:28:09.600362 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 19:28:09.600362 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 19:28:09.600362 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 19:28:09.600362 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24ad6e3e-6043-4eff-afb4-0c6039e825fa could not be found. Oct 31 19:28:09.600362 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Oct 31 19:28:09.600362 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 19:28:09.600362 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Oct 31 19:28:09.600362 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:28:09.600362 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 19:28:09.600362 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 19:28:09.600362 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 19:28:09.600362 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 19:28:09.600362 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24ad6e3e-6043-4eff-afb4-0c6039e825fa could not be found. Oct 31 19:28:09.600362 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Oct 31 19:28:09.601674 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-b410cd4b-4a9f-4422-a457-519fa8eb1fb7 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] Returning 404 to user: Instance 24ad6e3e-6043-4eff-afb4-0c6039e825fa could not be found. {{(pid=118726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 19:28:09.601674 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-b410cd4b-4a9f-4422-a457-519fa8eb1fb7 tempest-AttachVolumeShelveTestJSON-1845869762 tempest-AttachVolumeShelveTestJSON-1845869762-project] 10.222.0.16 "GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa" status: 404 len: 111 microversion: 2.20 time: 0.029248 Oct 31 19:28:09.601674 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 456/909] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 31 19:28:09 2022] GET /compute/v2.1/servers/24ad6e3e-6043-4eff-afb4-0c6039e825fa => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 31 19:28:16.200730 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-18c358cc-c4f0-4752-bda6-9238b6912625 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:28:16.201297 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-18c358cc-c4f0-4752-bda6-9238b6912625 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] [instance: fb16e6d4-57d8-4185-9955-ec1d261b365d] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:28:16.202901 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [req-b33f5fc4-a607-4ad0-bff2-a60df6c1e508 req-159baa28-2e40-47d0-baae-881c490825a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb16e6d4-57d8-4185-9955-ec1d261b365d", "tag": "d4d5c6c7-d643-4ff8-859d-8b480d999f74"}]} {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:28:16.208607 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-18c358cc-c4f0-4752-bda6-9238b6912625 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:28:16.209298 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-18c358cc-c4f0-4752-bda6-9238b6912625 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:28:16.209756 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-18c358cc-c4f0-4752-bda6-9238b6912625 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:28:16.210441 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-18c358cc-c4f0-4752-bda6-9238b6912625 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:28:16.211049 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-18c358cc-c4f0-4752-bda6-9238b6912625 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:28:16.211691 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-18c358cc-c4f0-4752-bda6-9238b6912625 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:28:16.214888 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [req-b33f5fc4-a607-4ad0-bff2-a60df6c1e508 req-159baa28-2e40-47d0-baae-881c490825a2 service nova] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:28:16.215366 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [req-b33f5fc4-a607-4ad0-bff2-a60df6c1e508 req-159baa28-2e40-47d0-baae-881c490825a2 service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:28:16.215984 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [req-b33f5fc4-a607-4ad0-bff2-a60df6c1e508 req-159baa28-2e40-47d0-baae-881c490825a2 service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:28:16.227402 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.compute.server_external_events [req-b33f5fc4-a607-4ad0-bff2-a60df6c1e508 req-159baa28-2e40-47d0-baae-881c490825a2 service nova] Creating event network-changed:d4d5c6c7-d643-4ff8-859d-8b480d999f74 for instance fb16e6d4-57d8-4185-9955-ec1d261b365d on hv-cinder-86309 Oct 31 19:28:16.233182 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [req-b33f5fc4-a607-4ad0-bff2-a60df6c1e508 req-159baa28-2e40-47d0-baae-881c490825a2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034068 Oct 31 19:28:16.233839 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 457/910] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 31 19:28:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:28:16.242035 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-18c358cc-c4f0-4752-bda6-9238b6912625 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] [instance: fb16e6d4-57d8-4185-9955-ec1d261b365d] Going to try to terminate instance {{(pid=118727) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 19:28:16.324778 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-18c358cc-c4f0-4752-bda6-9238b6912625 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] 10.222.0.16 "DELETE /compute/v2.1/servers/fb16e6d4-57d8-4185-9955-ec1d261b365d" status: 204 len: 0 microversion: 2.1 time: 0.127562 Oct 31 19:28:16.326122 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 454/911] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 31 19:28:16 2022] DELETE /compute/v2.1/servers/fb16e6d4-57d8-4185-9955-ec1d261b365d => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 19:28:16.336716 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-98382fa0-0a92-4448-9228-58b05ca1c919 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:28:16.337712 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-98382fa0-0a92-4448-9228-58b05ca1c919 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] [instance: fb16e6d4-57d8-4185-9955-ec1d261b365d] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:28:16.347789 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-98382fa0-0a92-4448-9228-58b05ca1c919 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:28:16.348899 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-98382fa0-0a92-4448-9228-58b05ca1c919 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:28:16.349714 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-98382fa0-0a92-4448-9228-58b05ca1c919 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:28:16.350629 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-98382fa0-0a92-4448-9228-58b05ca1c919 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:28:16.351503 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-98382fa0-0a92-4448-9228-58b05ca1c919 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:28:16.352012 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-98382fa0-0a92-4448-9228-58b05ca1c919 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:28:16.494425 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-98382fa0-0a92-4448-9228-58b05ca1c919 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5cfee7994ab404d974d86d77e075209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33bb29688304d0dae3cfdc0eb54b7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:28:16.505019 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-98382fa0-0a92-4448-9228-58b05ca1c919 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] 10.222.0.16 "GET /compute/v2.1/servers/fb16e6d4-57d8-4185-9955-ec1d261b365d" status: 200 len: 1568 microversion: 2.1 time: 0.174380 Oct 31 19:28:16.505888 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 458/912] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:28:16 2022] GET /compute/v2.1/servers/fb16e6d4-57d8-4185-9955-ec1d261b365d => generated 1568 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 19:28:17.531415 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-d0a55c41-681e-47d6-9ea1-0e16e0be4465 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:28:17.532022 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-d0a55c41-681e-47d6-9ea1-0e16e0be4465 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] [instance: fb16e6d4-57d8-4185-9955-ec1d261b365d] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:28:17.538311 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-d0a55c41-681e-47d6-9ea1-0e16e0be4465 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:28:17.538784 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-d0a55c41-681e-47d6-9ea1-0e16e0be4465 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:28:17.539386 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-d0a55c41-681e-47d6-9ea1-0e16e0be4465 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:28:17.540337 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-d0a55c41-681e-47d6-9ea1-0e16e0be4465 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:28:17.540789 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-d0a55c41-681e-47d6-9ea1-0e16e0be4465 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:28:17.541210 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-d0a55c41-681e-47d6-9ea1-0e16e0be4465 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:28:17.674321 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-d0a55c41-681e-47d6-9ea1-0e16e0be4465 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5cfee7994ab404d974d86d77e075209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33bb29688304d0dae3cfdc0eb54b7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:28:17.681901 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-d0a55c41-681e-47d6-9ea1-0e16e0be4465 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] 10.222.0.16 "GET /compute/v2.1/servers/fb16e6d4-57d8-4185-9955-ec1d261b365d" status: 200 len: 1568 microversion: 2.1 time: 0.154888 Oct 31 19:28:17.682470 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 455/913] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:28:17 2022] GET /compute/v2.1/servers/fb16e6d4-57d8-4185-9955-ec1d261b365d => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:28:18.705116 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-69e09c37-bfb4-4797-a00b-4a93dfdc88f3 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:28:18.705685 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-69e09c37-bfb4-4797-a00b-4a93dfdc88f3 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] [instance: fb16e6d4-57d8-4185-9955-ec1d261b365d] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:28:18.712082 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-69e09c37-bfb4-4797-a00b-4a93dfdc88f3 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:28:18.712589 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-69e09c37-bfb4-4797-a00b-4a93dfdc88f3 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:28:18.713013 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-69e09c37-bfb4-4797-a00b-4a93dfdc88f3 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:28:18.713720 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-69e09c37-bfb4-4797-a00b-4a93dfdc88f3 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:28:18.714168 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-69e09c37-bfb4-4797-a00b-4a93dfdc88f3 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:28:18.714586 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-69e09c37-bfb4-4797-a00b-4a93dfdc88f3 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:28:18.846042 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-69e09c37-bfb4-4797-a00b-4a93dfdc88f3 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5cfee7994ab404d974d86d77e075209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33bb29688304d0dae3cfdc0eb54b7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:28:18.853631 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-69e09c37-bfb4-4797-a00b-4a93dfdc88f3 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] 10.222.0.16 "GET /compute/v2.1/servers/fb16e6d4-57d8-4185-9955-ec1d261b365d" status: 200 len: 1568 microversion: 2.1 time: 0.152405 Oct 31 19:28:18.854182 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 459/914] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:28:18 2022] GET /compute/v2.1/servers/fb16e6d4-57d8-4185-9955-ec1d261b365d => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:28:19.876511 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-871fedee-498b-4dac-819e-b8fe75178d73 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:28:19.877682 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-871fedee-498b-4dac-819e-b8fe75178d73 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] [instance: fb16e6d4-57d8-4185-9955-ec1d261b365d] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:28:19.884296 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-871fedee-498b-4dac-819e-b8fe75178d73 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:28:19.884780 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-871fedee-498b-4dac-819e-b8fe75178d73 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:28:19.885213 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-871fedee-498b-4dac-819e-b8fe75178d73 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:28:19.885932 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-871fedee-498b-4dac-819e-b8fe75178d73 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:28:19.886388 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-871fedee-498b-4dac-819e-b8fe75178d73 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:28:19.886814 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-871fedee-498b-4dac-819e-b8fe75178d73 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:28:20.083951 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-871fedee-498b-4dac-819e-b8fe75178d73 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5cfee7994ab404d974d86d77e075209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33bb29688304d0dae3cfdc0eb54b7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:28:20.091891 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-871fedee-498b-4dac-819e-b8fe75178d73 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] 10.222.0.16 "GET /compute/v2.1/servers/fb16e6d4-57d8-4185-9955-ec1d261b365d" status: 200 len: 1568 microversion: 2.1 time: 0.219301 Oct 31 19:28:20.092453 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 456/915] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:28:19 2022] GET /compute/v2.1/servers/fb16e6d4-57d8-4185-9955-ec1d261b365d => generated 1568 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:28:21.116085 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-6262d1d2-bc15-472d-ade3-dfc07f1379de tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:28:21.116683 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-6262d1d2-bc15-472d-ade3-dfc07f1379de tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] [instance: fb16e6d4-57d8-4185-9955-ec1d261b365d] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:28:21.123680 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-6262d1d2-bc15-472d-ade3-dfc07f1379de tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:28:21.124218 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-6262d1d2-bc15-472d-ade3-dfc07f1379de tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:28:21.124651 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-6262d1d2-bc15-472d-ade3-dfc07f1379de tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:28:21.125446 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-6262d1d2-bc15-472d-ade3-dfc07f1379de tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:28:21.125930 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-6262d1d2-bc15-472d-ade3-dfc07f1379de tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:28:21.126427 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-6262d1d2-bc15-472d-ade3-dfc07f1379de tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:28:21.191105 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-6262d1d2-bc15-472d-ade3-dfc07f1379de tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5cfee7994ab404d974d86d77e075209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33bb29688304d0dae3cfdc0eb54b7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:28:21.198995 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-6262d1d2-bc15-472d-ade3-dfc07f1379de tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] 10.222.0.16 "GET /compute/v2.1/servers/fb16e6d4-57d8-4185-9955-ec1d261b365d" status: 200 len: 1381 microversion: 2.1 time: 0.086676 Oct 31 19:28:21.199481 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 460/916] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:28:21 2022] GET /compute/v2.1/servers/fb16e6d4-57d8-4185-9955-ec1d261b365d => generated 1381 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:28:21.228740 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [req-5881c525-69e4-47fd-869d-e83f687b1304 req-f26d458a-a3ec-48c6-88af-1406eabfc635 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb16e6d4-57d8-4185-9955-ec1d261b365d", "name": "network-vif-deleted", "tag": "d4d5c6c7-d643-4ff8-859d-8b480d999f74"}]} {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:28:21.239670 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [req-5881c525-69e4-47fd-869d-e83f687b1304 req-f26d458a-a3ec-48c6-88af-1406eabfc635 service nova] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:28:21.240143 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [req-5881c525-69e4-47fd-869d-e83f687b1304 req-f26d458a-a3ec-48c6-88af-1406eabfc635 service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:28:21.240573 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [req-5881c525-69e4-47fd-869d-e83f687b1304 req-f26d458a-a3ec-48c6-88af-1406eabfc635 service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:28:21.251689 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.compute.server_external_events [req-5881c525-69e4-47fd-869d-e83f687b1304 req-f26d458a-a3ec-48c6-88af-1406eabfc635 service nova] Creating event network-vif-deleted:d4d5c6c7-d643-4ff8-859d-8b480d999f74 for instance fb16e6d4-57d8-4185-9955-ec1d261b365d on hv-cinder-86309 Oct 31 19:28:21.257171 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [req-5881c525-69e4-47fd-869d-e83f687b1304 req-f26d458a-a3ec-48c6-88af-1406eabfc635 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032271 Oct 31 19:28:21.257803 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 457/917] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 31 19:28:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:28:22.222902 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-6b7ffa80-b432-4816-880f-fc1e80d8b030 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:28:22.223509 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-6b7ffa80-b432-4816-880f-fc1e80d8b030 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] [instance: fb16e6d4-57d8-4185-9955-ec1d261b365d] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:28:22.229805 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-6b7ffa80-b432-4816-880f-fc1e80d8b030 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:28:22.230281 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-6b7ffa80-b432-4816-880f-fc1e80d8b030 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:28:22.230710 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-6b7ffa80-b432-4816-880f-fc1e80d8b030 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:28:22.231399 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-6b7ffa80-b432-4816-880f-fc1e80d8b030 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:28:22.231848 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-6b7ffa80-b432-4816-880f-fc1e80d8b030 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:28:22.232268 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-6b7ffa80-b432-4816-880f-fc1e80d8b030 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:28:22.247502 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.wsgi [None req-6b7ffa80-b432-4816-880f-fc1e80d8b030 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] HTTP exception thrown: Instance fb16e6d4-57d8-4185-9955-ec1d261b365d could not be found. Oct 31 19:28:22.249121 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-6b7ffa80-b432-4816-880f-fc1e80d8b030 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Request method failure captured: Oct 31 19:28:22.249121 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: request: GET /compute/v2.1/servers/fb16e6d4-57d8-4185-9955-ec1d261b365d HTTP/1.1 Oct 31 19:28:22.249121 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: Accept: application/json Oct 31 19:28:22.249121 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: Accept-Encoding: identity Oct 31 19:28:22.249121 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: Connection: close Oct 31 19:28:22.249121 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: Content-Length: 0 Oct 31 19:28:22.249121 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: Content-Type: application/json Oct 31 19:28:22.249121 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: Host: 10.222.0.16 Oct 31 19:28:22.249121 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: Openstack-System-Scope: None Oct 31 19:28:22.249121 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: User-Agent: python-urllib3/1.26.12 Oct 31 19:28:22.249121 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Auth-Token: gAAAAABjYCBzA5EpRoAuyg_BlAqtm2ygFBmeEyTT66-lEOqjSGdw8QS3KN-w_SMYe08wLd9F2jbkgVc0oOSFqlpQb13A6gEoE3y18XFslnOaVrEK76x09P7lUK5osDGp6XG9LQH6v_mGVGV1FqDQOPhSE7-JNaJlEukDjkCOj7N_7yEuy2HB81g Oct 31 19:28:22.249121 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Domain-Id: None Oct 31 19:28:22.249121 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Domain-Name: None Oct 31 19:28:22.249121 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Identity-Status: Confirmed Oct 31 19:28:22.249121 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Is-Admin-Project: True Oct 31 19:28:22.249121 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Project-Domain-Id: default Oct 31 19:28:22.249121 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Project-Domain-Name: Default Oct 31 19:28:22.249121 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Project-Id: a33bb29688304d0dae3cfdc0eb54b7be Oct 31 19:28:22.249121 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Project-Name: tempest-TestShelveInstance-592145345 Oct 31 19:28:22.249121 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Role: member,reader Oct 31 19:28:22.249121 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Roles: member,reader Oct 31 19:28:22.250848 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a33bb29688304d0dae3cfdc0eb54b7be"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a33bb29688304d0dae3cfdc0eb54b7be", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a33bb29688304d0dae3cfdc0eb54b7be"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a33bb29688304d0dae3cfdc0eb54b7be"}]}] Oct 31 19:28:22.250848 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Tenant: tempest-TestShelveInstance-592145345 Oct 31 19:28:22.250848 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Tenant-Id: a33bb29688304d0dae3cfdc0eb54b7be Oct 31 19:28:22.250848 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Tenant-Name: tempest-TestShelveInstance-592145345 Oct 31 19:28:22.250848 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-User: tempest-TestShelveInstance-592145345-project Oct 31 19:28:22.250848 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-User-Domain-Id: default Oct 31 19:28:22.250848 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-User-Domain-Name: Default Oct 31 19:28:22.250848 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-User-Id: d5cfee7994ab404d974d86d77e075209 Oct 31 19:28:22.250848 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-User-Name: tempest-TestShelveInstance-592145345-project Oct 31 19:28:22.250848 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: method: > Oct 31 19:28:22.250848 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: exception: Instance fb16e6d4-57d8-4185-9955-ec1d261b365d could not be found. Oct 31 19:28:22.250848 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: action_args: {'id': 'fb16e6d4-57d8-4185-9955-ec1d261b365d'} Oct 31 19:28:22.251902 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 19:28:22.251902 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:28:22.251902 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 19:28:22.251902 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 19:28:22.251902 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 19:28:22.251902 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 19:28:22.251902 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 19:28:22.251902 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 19:28:22.251902 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 19:28:22.251902 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 19:28:22.251902 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb16e6d4-57d8-4185-9955-ec1d261b365d could not be found. Oct 31 19:28:22.251902 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Oct 31 19:28:22.251902 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 19:28:22.251902 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Oct 31 19:28:22.251902 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:28:22.251902 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 19:28:22.251902 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 19:28:22.251902 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 19:28:22.251902 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 19:28:22.251902 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 19:28:22.253562 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 19:28:22.253562 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 19:28:22.253562 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 19:28:22.253562 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 19:28:22.253562 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 19:28:22.253562 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 19:28:22.253562 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 19:28:22.253562 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb16e6d4-57d8-4185-9955-ec1d261b365d could not be found. Oct 31 19:28:22.253562 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Oct 31 19:28:22.253562 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 19:28:22.253562 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Oct 31 19:28:22.253562 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:28:22.253562 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 19:28:22.253562 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 19:28:22.253562 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 19:28:22.253562 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 19:28:22.253562 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb16e6d4-57d8-4185-9955-ec1d261b365d could not be found. Oct 31 19:28:22.253562 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Oct 31 19:28:22.255019 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-6b7ffa80-b432-4816-880f-fc1e80d8b030 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Returning 404 to user: Instance fb16e6d4-57d8-4185-9955-ec1d261b365d could not be found. {{(pid=118726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 19:28:22.255019 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-6b7ffa80-b432-4816-880f-fc1e80d8b030 tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] 10.222.0.16 "GET /compute/v2.1/servers/fb16e6d4-57d8-4185-9955-ec1d261b365d" status: 404 len: 111 microversion: 2.1 time: 0.032546 Oct 31 19:28:22.255019 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 461/918] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:28:22 2022] GET /compute/v2.1/servers/fb16e6d4-57d8-4185-9955-ec1d261b365d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 19:28:22.420681 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-f3c6788b-5860-4490-a2c0-3abe5c035b0e tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] Calling method '.version_select at 0x7f34f207dc10>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:28:22.441495 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-f3c6788b-5860-4490-a2c0-3abe5c035b0e tempest-TestShelveInstance-592145345 tempest-TestShelveInstance-592145345-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-563463545" status: 202 len: 0 microversion: 2.1 time: 0.026121 Oct 31 19:28:22.442116 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 458/919] 10.222.0.16 () {58 vars in 1251 bytes} [Mon Oct 31 19:28:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-563463545 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 19:28:42.318100 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-74026b7a-3704-4c95-a045-c8fa052a0f51 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:28:42.318665 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-74026b7a-3704-4c95-a045-c8fa052a0f51 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] [instance: 1fd43154-badc-47b6-a5a7-d1f28e759bb0] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:28:42.321349 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG dbcounter [-] [118726] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3 {{(pid=118726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:28:42.322232 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG dbcounter [-] [118726] Writing DB stats nova_cell1:SELECT=74 {{(pid=118726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:28:42.328665 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-74026b7a-3704-4c95-a045-c8fa052a0f51 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:28:42.329142 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-74026b7a-3704-4c95-a045-c8fa052a0f51 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:28:42.329582 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-74026b7a-3704-4c95-a045-c8fa052a0f51 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:28:42.330298 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-74026b7a-3704-4c95-a045-c8fa052a0f51 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:28:42.331385 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-74026b7a-3704-4c95-a045-c8fa052a0f51 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:28:42.331812 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-74026b7a-3704-4c95-a045-c8fa052a0f51 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:28:42.354709 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-74026b7a-3704-4c95-a045-c8fa052a0f51 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] 10.222.0.16 "GET /compute/v2.1/servers/1fd43154-badc-47b6-a5a7-d1f28e759bb0/ips" status: 200 len: 150 microversion: 2.1 time: 0.041054 Oct 31 19:28:42.355261 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 462/920] 10.222.0.16 () {58 vars in 1248 bytes} [Mon Oct 31 19:28:42 2022] GET /compute/v2.1/servers/1fd43154-badc-47b6-a5a7-d1f28e759bb0/ips => generated 150 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:28:43.722247 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG dbcounter [-] [118727] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:28:43.722982 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG dbcounter [-] [118727] Writing DB stats nova_api:SELECT=28,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=118727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:28:43.727639 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-ab7afb6b-bae9-469c-804b-ba479ac99516 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dfda8425-9a81-4cdc-b619-1b0eb87b9e95"}} {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:28:43.730016 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-ab7afb6b-bae9-469c-804b-ba479ac99516 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] [instance: 1fd43154-badc-47b6-a5a7-d1f28e759bb0] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:28:43.739119 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-ab7afb6b-bae9-469c-804b-ba479ac99516 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:28:43.739616 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-ab7afb6b-bae9-469c-804b-ba479ac99516 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:28:43.740054 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-ab7afb6b-bae9-469c-804b-ba479ac99516 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:28:43.740801 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-ab7afb6b-bae9-469c-804b-ba479ac99516 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:28:43.741253 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-ab7afb6b-bae9-469c-804b-ba479ac99516 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:28:43.741701 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-ab7afb6b-bae9-469c-804b-ba479ac99516 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:28:43.979924 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-ab7afb6b-bae9-469c-804b-ba479ac99516 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] 10.222.0.16 "POST /compute/v2.1/servers/1fd43154-badc-47b6-a5a7-d1f28e759bb0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.259797 Oct 31 19:28:43.980841 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 459/921] 10.222.0.16 () {60 vars in 1323 bytes} [Mon Oct 31 19:28:43 2022] POST /compute/v2.1/servers/1fd43154-badc-47b6-a5a7-d1f28e759bb0/os-volume_attachments => generated 194 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:28:50.472434 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-4bc1c9e0-a518-4f0f-ae19-22445af209e9 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Action: 'create', calling method: .version_select at 0x7f34f1efd670>, body: {"keypair": {"name": "tempest-keypair-1704044515", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNrcaB8F+QQvf2iq9wVA3ocr3aJJBoVMW5XRoUziZ2f2sByCszRh9Xa+Cs8IV0t+VRpgaIgcUrOsI9dLaw95W/0GspqVGyR1KTjCJHKZEVe7xdPV5SjLSGdo1Ker/RknKQ=="}} {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:28:50.487663 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.quota [None req-4bc1c9e0-a518-4f0f-ae19-22445af209e9 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Getting quotas for project adba9bc456234ea6ade63d41a1624967. Resources: {'key_pairs'} {{(pid=118726) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 19:28:50.491434 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.quota [None req-4bc1c9e0-a518-4f0f-ae19-22445af209e9 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Getting quotas for user 16778b0dd21d41eeaa6087b67931eef8 and project adba9bc456234ea6ade63d41a1624967. Resources: {'key_pairs'} {{(pid=118726) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 19:28:50.513739 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-4bc1c9e0-a518-4f0f-ae19-22445af209e9 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.045222 Oct 31 19:28:50.514320 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 463/922] 10.222.0.16 () {60 vars in 1159 bytes} [Mon Oct 31 19:28:50 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:28:51.799017 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-859035fa-8b96-444c-beac-03674e782409 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1763969026", "imageRef": "a9795ee0-6722-4e1e-8fc8-a6c2e68f3049", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fa342027-4076-4973-b2c6-612147f6fd68"}], "security_groups": [{"name": "tempest-securitygroup--1512653389"}], "key_name": "tempest-keypair-1704044515", "user_data": "}} {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:28:51.907097 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.network.neutron [None req-859035fa-8b96-444c-beac-03674e782409 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] validate_networks() for [('fa342027-4076-4973-b2c6-612147f6fd68', None, None, None, None, None)] {{(pid=118727) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 19:28:52.496671 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.virt.hardware [None req-859035fa-8b96-444c-beac-03674e782409 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Flavor limits 0:0:0 {{(pid=118727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 19:28:52.497180 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.virt.hardware [None req-859035fa-8b96-444c-beac-03674e782409 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Image limits 0:0:0 {{(pid=118727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 19:28:52.497745 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.virt.hardware [None req-859035fa-8b96-444c-beac-03674e782409 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Flavor pref 0:0:0 {{(pid=118727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 19:28:52.498214 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.virt.hardware [None req-859035fa-8b96-444c-beac-03674e782409 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Image pref 0:0:0 {{(pid=118727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 19:28:52.498700 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.virt.hardware [None req-859035fa-8b96-444c-beac-03674e782409 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 19:28:52.507789 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-859035fa-8b96-444c-beac-03674e782409 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:28:52.508263 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-859035fa-8b96-444c-beac-03674e782409 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:28:52.508691 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-859035fa-8b96-444c-beac-03674e782409 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:28:52.509401 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-859035fa-8b96-444c-beac-03674e782409 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:28:52.510031 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-859035fa-8b96-444c-beac-03674e782409 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:28:52.510450 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-859035fa-8b96-444c-beac-03674e782409 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:28:52.527967 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.quota [None req-859035fa-8b96-444c-beac-03674e782409 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Getting quotas for project adba9bc456234ea6ade63d41a1624967. Resources: {'instances', 'ram', 'cores'} {{(pid=118727) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 19:28:52.531826 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.quota [None req-859035fa-8b96-444c-beac-03674e782409 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Getting quotas for user 16778b0dd21d41eeaa6087b67931eef8 and project adba9bc456234ea6ade63d41a1624967. Resources: {'instances', 'ram', 'cores'} {{(pid=118727) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 19:28:52.546697 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-859035fa-8b96-444c-beac-03674e782409 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Going to run 1 instances... {{(pid=118727) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 19:28:52.549383 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-859035fa-8b96-444c-beac-03674e782409 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] [instance: a3be5488-67cf-4a84-ae40-9c0bf189ffd1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9795ee0-6722-4e1e-8fc8-a6c2e68f3049',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118727) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 19:28:52.606571 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-859035fa-8b96-444c-beac-03674e782409 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.813159 Oct 31 19:28:52.607259 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 460/923] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 31 19:28:51 2022] POST /compute/v2.1/servers => generated 402 bytes in 815 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 19:28:52.615616 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG dbcounter [-] [118726] Writing DB stats nova_cell1:SELECT=4 {{(pid=118726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:28:52.619933 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-af4462ff-2af0-423d-92ba-b9e53ee04745 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:28:52.620537 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-af4462ff-2af0-423d-92ba-b9e53ee04745 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] [instance: a3be5488-67cf-4a84-ae40-9c0bf189ffd1] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:28:52.689040 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-af4462ff-2af0-423d-92ba-b9e53ee04745 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16778b0dd21d41eeaa6087b67931eef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba9bc456234ea6ade63d41a1624967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:28:52.699413 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-af4462ff-2af0-423d-92ba-b9e53ee04745 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] 10.222.0.16 "GET /compute/v2.1/servers/a3be5488-67cf-4a84-ae40-9c0bf189ffd1" status: 200 len: 1242 microversion: 2.1 time: 0.084921 Oct 31 19:28:52.701033 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 464/924] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:28:52 2022] GET /compute/v2.1/servers/a3be5488-67cf-4a84-ae40-9c0bf189ffd1 => generated 1242 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:28:53.726616 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-db0a12cf-b773-4e13-9b93-ab3278bf83cf tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:28:53.727249 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-db0a12cf-b773-4e13-9b93-ab3278bf83cf tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] [instance: a3be5488-67cf-4a84-ae40-9c0bf189ffd1] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:28:53.734814 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-db0a12cf-b773-4e13-9b93-ab3278bf83cf tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:28:53.735305 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-db0a12cf-b773-4e13-9b93-ab3278bf83cf tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:28:53.735734 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-db0a12cf-b773-4e13-9b93-ab3278bf83cf tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:28:53.736474 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-db0a12cf-b773-4e13-9b93-ab3278bf83cf tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:28:53.737539 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-db0a12cf-b773-4e13-9b93-ab3278bf83cf tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:28:53.737990 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-db0a12cf-b773-4e13-9b93-ab3278bf83cf tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:28:53.863178 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-db0a12cf-b773-4e13-9b93-ab3278bf83cf tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16778b0dd21d41eeaa6087b67931eef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba9bc456234ea6ade63d41a1624967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:28:53.876715 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-db0a12cf-b773-4e13-9b93-ab3278bf83cf tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] 10.222.0.16 "GET /compute/v2.1/servers/a3be5488-67cf-4a84-ae40-9c0bf189ffd1" status: 200 len: 1302 microversion: 2.1 time: 0.155042 Oct 31 19:28:53.882079 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 461/925] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:28:53 2022] GET /compute/v2.1/servers/a3be5488-67cf-4a84-ae40-9c0bf189ffd1 => generated 1302 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:28:54.900373 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-5530969f-fd4e-47e0-aff3-e381c643299d tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:28:54.901304 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-5530969f-fd4e-47e0-aff3-e381c643299d tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] [instance: a3be5488-67cf-4a84-ae40-9c0bf189ffd1] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:28:54.907977 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-5530969f-fd4e-47e0-aff3-e381c643299d tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:28:54.909339 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-5530969f-fd4e-47e0-aff3-e381c643299d tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:28:54.910072 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-5530969f-fd4e-47e0-aff3-e381c643299d tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:28:54.911777 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-5530969f-fd4e-47e0-aff3-e381c643299d tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:28:54.912476 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-5530969f-fd4e-47e0-aff3-e381c643299d tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:28:54.913153 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-5530969f-fd4e-47e0-aff3-e381c643299d tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:28:55.072596 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-5530969f-fd4e-47e0-aff3-e381c643299d tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16778b0dd21d41eeaa6087b67931eef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba9bc456234ea6ade63d41a1624967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:28:55.080378 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-5530969f-fd4e-47e0-aff3-e381c643299d tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] 10.222.0.16 "GET /compute/v2.1/servers/a3be5488-67cf-4a84-ae40-9c0bf189ffd1" status: 200 len: 1368 microversion: 2.1 time: 0.183791 Oct 31 19:28:55.080945 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 465/926] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:28:54 2022] GET /compute/v2.1/servers/a3be5488-67cf-4a84-ae40-9c0bf189ffd1 => generated 1368 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:28:55.546231 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [req-8c5289de-aa19-4568-a1cd-42f6bcdfb0b3 req-afd97f11-cfab-40f6-b186-a014827215c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3be5488-67cf-4a84-ae40-9c0bf189ffd1", "tag": "6b41a25b-20b6-415c-930e-d9c6d014f1aa"}]} {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:28:55.559015 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [req-8c5289de-aa19-4568-a1cd-42f6bcdfb0b3 req-afd97f11-cfab-40f6-b186-a014827215c7 service nova] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:28:55.559835 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [req-8c5289de-aa19-4568-a1cd-42f6bcdfb0b3 req-afd97f11-cfab-40f6-b186-a014827215c7 service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:28:55.560476 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [req-8c5289de-aa19-4568-a1cd-42f6bcdfb0b3 req-afd97f11-cfab-40f6-b186-a014827215c7 service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:28:55.575985 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.compute.server_external_events [req-8c5289de-aa19-4568-a1cd-42f6bcdfb0b3 req-afd97f11-cfab-40f6-b186-a014827215c7 service nova] Creating event network-changed:6b41a25b-20b6-415c-930e-d9c6d014f1aa for instance a3be5488-67cf-4a84-ae40-9c0bf189ffd1 on hv-cinder-86309 Oct 31 19:28:55.581471 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [req-8c5289de-aa19-4568-a1cd-42f6bcdfb0b3 req-afd97f11-cfab-40f6-b186-a014827215c7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039246 Oct 31 19:28:55.582097 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 462/927] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 31 19:28:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:28:56.103715 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-09546e3a-30a7-4215-a2d0-ec69a080f0a7 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:28:56.104886 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-09546e3a-30a7-4215-a2d0-ec69a080f0a7 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] [instance: a3be5488-67cf-4a84-ae40-9c0bf189ffd1] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:28:56.111339 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-09546e3a-30a7-4215-a2d0-ec69a080f0a7 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:28:56.112487 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-09546e3a-30a7-4215-a2d0-ec69a080f0a7 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:28:56.112947 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-09546e3a-30a7-4215-a2d0-ec69a080f0a7 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:28:56.113841 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-09546e3a-30a7-4215-a2d0-ec69a080f0a7 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:28:56.114296 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-09546e3a-30a7-4215-a2d0-ec69a080f0a7 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:28:56.114791 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-09546e3a-30a7-4215-a2d0-ec69a080f0a7 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:28:56.251895 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-09546e3a-30a7-4215-a2d0-ec69a080f0a7 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16778b0dd21d41eeaa6087b67931eef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba9bc456234ea6ade63d41a1624967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:28:56.259439 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-09546e3a-30a7-4215-a2d0-ec69a080f0a7 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] 10.222.0.16 "GET /compute/v2.1/servers/a3be5488-67cf-4a84-ae40-9c0bf189ffd1" status: 200 len: 1368 microversion: 2.1 time: 0.160076 Oct 31 19:28:56.260013 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 466/928] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:28:56 2022] GET /compute/v2.1/servers/a3be5488-67cf-4a84-ae40-9c0bf189ffd1 => generated 1368 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:28:57.283294 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-28698c91-8f04-46db-99d5-1854b3bf8f9f tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:28:57.284477 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-28698c91-8f04-46db-99d5-1854b3bf8f9f tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] [instance: a3be5488-67cf-4a84-ae40-9c0bf189ffd1] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:28:57.290731 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-28698c91-8f04-46db-99d5-1854b3bf8f9f tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:28:57.291213 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-28698c91-8f04-46db-99d5-1854b3bf8f9f tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:28:57.291644 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-28698c91-8f04-46db-99d5-1854b3bf8f9f tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:28:57.292332 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-28698c91-8f04-46db-99d5-1854b3bf8f9f tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:28:57.292786 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-28698c91-8f04-46db-99d5-1854b3bf8f9f tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:28:57.293211 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-28698c91-8f04-46db-99d5-1854b3bf8f9f tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:28:57.429636 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-28698c91-8f04-46db-99d5-1854b3bf8f9f tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16778b0dd21d41eeaa6087b67931eef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba9bc456234ea6ade63d41a1624967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:28:57.437865 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-28698c91-8f04-46db-99d5-1854b3bf8f9f tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] 10.222.0.16 "GET /compute/v2.1/servers/a3be5488-67cf-4a84-ae40-9c0bf189ffd1" status: 200 len: 1368 microversion: 2.1 time: 0.159134 Oct 31 19:28:57.448457 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 463/929] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:28:57 2022] GET /compute/v2.1/servers/a3be5488-67cf-4a84-ae40-9c0bf189ffd1 => generated 1368 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:28:58.460229 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-35e71eac-7266-4c24-a75a-b85fbc5cf943 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:28:58.460867 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-35e71eac-7266-4c24-a75a-b85fbc5cf943 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] [instance: a3be5488-67cf-4a84-ae40-9c0bf189ffd1] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:28:58.467165 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-35e71eac-7266-4c24-a75a-b85fbc5cf943 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:28:58.467639 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-35e71eac-7266-4c24-a75a-b85fbc5cf943 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:28:58.468071 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-35e71eac-7266-4c24-a75a-b85fbc5cf943 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:28:58.468750 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-35e71eac-7266-4c24-a75a-b85fbc5cf943 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:28:58.469199 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-35e71eac-7266-4c24-a75a-b85fbc5cf943 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:28:58.469644 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-35e71eac-7266-4c24-a75a-b85fbc5cf943 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:28:58.597558 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-35e71eac-7266-4c24-a75a-b85fbc5cf943 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16778b0dd21d41eeaa6087b67931eef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba9bc456234ea6ade63d41a1624967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:28:58.605077 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-35e71eac-7266-4c24-a75a-b85fbc5cf943 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] 10.222.0.16 "GET /compute/v2.1/servers/a3be5488-67cf-4a84-ae40-9c0bf189ffd1" status: 200 len: 1368 microversion: 2.1 time: 0.148678 Oct 31 19:28:58.605660 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 467/930] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:28:58 2022] GET /compute/v2.1/servers/a3be5488-67cf-4a84-ae40-9c0bf189ffd1 => generated 1368 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:28:59.634168 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-3cee22cc-a7f6-40ba-9694-177c6fe3a7f2 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:28:59.634769 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-3cee22cc-a7f6-40ba-9694-177c6fe3a7f2 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] [instance: a3be5488-67cf-4a84-ae40-9c0bf189ffd1] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:28:59.641298 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-3cee22cc-a7f6-40ba-9694-177c6fe3a7f2 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:28:59.641831 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-3cee22cc-a7f6-40ba-9694-177c6fe3a7f2 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:28:59.642262 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-3cee22cc-a7f6-40ba-9694-177c6fe3a7f2 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:28:59.643507 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-3cee22cc-a7f6-40ba-9694-177c6fe3a7f2 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:28:59.643954 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-3cee22cc-a7f6-40ba-9694-177c6fe3a7f2 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:28:59.644369 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-3cee22cc-a7f6-40ba-9694-177c6fe3a7f2 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:28:59.780282 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-3cee22cc-a7f6-40ba-9694-177c6fe3a7f2 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16778b0dd21d41eeaa6087b67931eef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba9bc456234ea6ade63d41a1624967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:28:59.786902 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-3cee22cc-a7f6-40ba-9694-177c6fe3a7f2 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] 10.222.0.16 "GET /compute/v2.1/servers/a3be5488-67cf-4a84-ae40-9c0bf189ffd1" status: 200 len: 1368 microversion: 2.1 time: 0.156523 Oct 31 19:28:59.787479 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 464/931] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:28:59 2022] GET /compute/v2.1/servers/a3be5488-67cf-4a84-ae40-9c0bf189ffd1 => generated 1368 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:29:00.809953 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-5cd0ca1e-5d83-46ce-b361-1daadd28ad66 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:29:00.810678 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-5cd0ca1e-5d83-46ce-b361-1daadd28ad66 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] [instance: a3be5488-67cf-4a84-ae40-9c0bf189ffd1] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:29:00.817257 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-5cd0ca1e-5d83-46ce-b361-1daadd28ad66 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:29:00.817775 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-5cd0ca1e-5d83-46ce-b361-1daadd28ad66 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:29:00.818212 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-5cd0ca1e-5d83-46ce-b361-1daadd28ad66 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:29:00.818912 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-5cd0ca1e-5d83-46ce-b361-1daadd28ad66 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:29:00.819369 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-5cd0ca1e-5d83-46ce-b361-1daadd28ad66 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:29:00.819794 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-5cd0ca1e-5d83-46ce-b361-1daadd28ad66 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:29:00.958723 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-5cd0ca1e-5d83-46ce-b361-1daadd28ad66 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16778b0dd21d41eeaa6087b67931eef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba9bc456234ea6ade63d41a1624967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:29:00.966381 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-5cd0ca1e-5d83-46ce-b361-1daadd28ad66 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] 10.222.0.16 "GET /compute/v2.1/servers/a3be5488-67cf-4a84-ae40-9c0bf189ffd1" status: 200 len: 1368 microversion: 2.1 time: 0.160389 Oct 31 19:29:00.967115 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 468/932] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:29:00 2022] GET /compute/v2.1/servers/a3be5488-67cf-4a84-ae40-9c0bf189ffd1 => generated 1368 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:29:01.988639 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-4fb871a5-2ffe-4056-9bc4-dea8258f1d01 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:29:01.989239 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-4fb871a5-2ffe-4056-9bc4-dea8258f1d01 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] [instance: a3be5488-67cf-4a84-ae40-9c0bf189ffd1] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:29:01.998456 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-4fb871a5-2ffe-4056-9bc4-dea8258f1d01 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:29:01.998456 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-4fb871a5-2ffe-4056-9bc4-dea8258f1d01 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:29:01.998456 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-4fb871a5-2ffe-4056-9bc4-dea8258f1d01 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:29:01.998456 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-4fb871a5-2ffe-4056-9bc4-dea8258f1d01 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:29:01.998839 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-4fb871a5-2ffe-4056-9bc4-dea8258f1d01 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:29:01.998839 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-4fb871a5-2ffe-4056-9bc4-dea8258f1d01 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:29:02.130066 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-4fb871a5-2ffe-4056-9bc4-dea8258f1d01 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16778b0dd21d41eeaa6087b67931eef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba9bc456234ea6ade63d41a1624967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:29:02.137701 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-4fb871a5-2ffe-4056-9bc4-dea8258f1d01 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] 10.222.0.16 "GET /compute/v2.1/servers/a3be5488-67cf-4a84-ae40-9c0bf189ffd1" status: 200 len: 1368 microversion: 2.1 time: 0.153369 Oct 31 19:29:02.138266 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 465/933] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:29:01 2022] GET /compute/v2.1/servers/a3be5488-67cf-4a84-ae40-9c0bf189ffd1 => generated 1368 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:29:02.433184 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [req-79de40a9-782f-4c44-b1d5-ecd8f25096a1 req-aadfb2cc-4801-4b5a-abfc-d0aeb0ef10d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3be5488-67cf-4a84-ae40-9c0bf189ffd1", "name": "network-vif-plugged", "status": "completed", "tag": "6b41a25b-20b6-415c-930e-d9c6d014f1aa"}]} {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:29:02.444322 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [req-79de40a9-782f-4c44-b1d5-ecd8f25096a1 req-aadfb2cc-4801-4b5a-abfc-d0aeb0ef10d3 service nova] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:29:02.444841 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [req-79de40a9-782f-4c44-b1d5-ecd8f25096a1 req-aadfb2cc-4801-4b5a-abfc-d0aeb0ef10d3 service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:29:02.445454 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [req-79de40a9-782f-4c44-b1d5-ecd8f25096a1 req-aadfb2cc-4801-4b5a-abfc-d0aeb0ef10d3 service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:29:02.457829 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.compute.server_external_events [req-79de40a9-782f-4c44-b1d5-ecd8f25096a1 req-aadfb2cc-4801-4b5a-abfc-d0aeb0ef10d3 service nova] Creating event network-vif-plugged:6b41a25b-20b6-415c-930e-d9c6d014f1aa for instance a3be5488-67cf-4a84-ae40-9c0bf189ffd1 on hv-cinder-86309 Oct 31 19:29:02.464076 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [req-79de40a9-782f-4c44-b1d5-ecd8f25096a1 req-aadfb2cc-4801-4b5a-abfc-d0aeb0ef10d3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035373 Oct 31 19:29:02.464757 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 469/934] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 31 19:29:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:29:03.161348 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-e3b2fbdd-0f6f-4e53-8177-08c508ad6800 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:29:03.161995 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-e3b2fbdd-0f6f-4e53-8177-08c508ad6800 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] [instance: a3be5488-67cf-4a84-ae40-9c0bf189ffd1] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:29:03.163955 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG dbcounter [-] [118727] Writing DB stats nova_cell0:SELECT=2 {{(pid=118727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:29:03.164852 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG dbcounter [-] [118727] Writing DB stats nova_cell0:SELECT=6 {{(pid=118727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:29:03.171312 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-e3b2fbdd-0f6f-4e53-8177-08c508ad6800 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:29:03.171803 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-e3b2fbdd-0f6f-4e53-8177-08c508ad6800 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:29:03.172239 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-e3b2fbdd-0f6f-4e53-8177-08c508ad6800 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:29:03.172954 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-e3b2fbdd-0f6f-4e53-8177-08c508ad6800 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:29:03.173410 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-e3b2fbdd-0f6f-4e53-8177-08c508ad6800 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:29:03.174497 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-e3b2fbdd-0f6f-4e53-8177-08c508ad6800 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:29:03.301754 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-e3b2fbdd-0f6f-4e53-8177-08c508ad6800 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16778b0dd21d41eeaa6087b67931eef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba9bc456234ea6ade63d41a1624967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:29:03.309354 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-e3b2fbdd-0f6f-4e53-8177-08c508ad6800 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] 10.222.0.16 "GET /compute/v2.1/servers/a3be5488-67cf-4a84-ae40-9c0bf189ffd1" status: 200 len: 1368 microversion: 2.1 time: 0.152862 Oct 31 19:29:03.309943 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 466/935] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:29:03 2022] GET /compute/v2.1/servers/a3be5488-67cf-4a84-ae40-9c0bf189ffd1 => generated 1368 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:29:04.329102 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG dbcounter [-] [118726] Writing DB stats nova_cell0:SELECT=6 {{(pid=118726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:29:04.333792 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-e8bfc0cd-5565-4117-a171-e045094a2d66 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:29:04.334524 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-e8bfc0cd-5565-4117-a171-e045094a2d66 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] [instance: a3be5488-67cf-4a84-ae40-9c0bf189ffd1] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:29:04.340833 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-e8bfc0cd-5565-4117-a171-e045094a2d66 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:29:04.341311 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-e8bfc0cd-5565-4117-a171-e045094a2d66 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:29:04.341779 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-e8bfc0cd-5565-4117-a171-e045094a2d66 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:29:04.342465 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-e8bfc0cd-5565-4117-a171-e045094a2d66 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:29:04.342919 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-e8bfc0cd-5565-4117-a171-e045094a2d66 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:29:04.343343 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-e8bfc0cd-5565-4117-a171-e045094a2d66 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:29:04.475101 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-e8bfc0cd-5565-4117-a171-e045094a2d66 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16778b0dd21d41eeaa6087b67931eef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba9bc456234ea6ade63d41a1624967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:29:04.482842 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-e8bfc0cd-5565-4117-a171-e045094a2d66 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] 10.222.0.16 "GET /compute/v2.1/servers/a3be5488-67cf-4a84-ae40-9c0bf189ffd1" status: 200 len: 1557 microversion: 2.1 time: 0.154740 Oct 31 19:29:04.483549 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 470/936] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:29:04 2022] GET /compute/v2.1/servers/a3be5488-67cf-4a84-ae40-9c0bf189ffd1 => generated 1557 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:29:04.507604 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-023cbfff-f825-4d46-b32d-77a55faef993 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:29:04.508265 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-023cbfff-f825-4d46-b32d-77a55faef993 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] [instance: a3be5488-67cf-4a84-ae40-9c0bf189ffd1] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:29:04.515550 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-023cbfff-f825-4d46-b32d-77a55faef993 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:29:04.516150 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-023cbfff-f825-4d46-b32d-77a55faef993 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:29:04.516668 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-023cbfff-f825-4d46-b32d-77a55faef993 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:29:04.517512 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-023cbfff-f825-4d46-b32d-77a55faef993 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:29:04.518107 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-023cbfff-f825-4d46-b32d-77a55faef993 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:29:04.518582 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-023cbfff-f825-4d46-b32d-77a55faef993 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:29:04.598771 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-023cbfff-f825-4d46-b32d-77a55faef993 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] 10.222.0.16 "GET /compute/v2.1/servers/a3be5488-67cf-4a84-ae40-9c0bf189ffd1/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.097147 Oct 31 19:29:04.599362 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 467/937] 10.222.0.16 () {58 vars in 1275 bytes} [Mon Oct 31 19:29:04 2022] GET /compute/v2.1/servers/a3be5488-67cf-4a84-ae40-9c0bf189ffd1/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:29:05.519989 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [req-06f6841d-bbc2-45e2-b6a6-18ee3b873f8b req-8a827d7a-5df7-47d3-930b-fb2243f84d22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3be5488-67cf-4a84-ae40-9c0bf189ffd1", "tag": "6b41a25b-20b6-415c-930e-d9c6d014f1aa"}]} {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:29:05.529818 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [req-06f6841d-bbc2-45e2-b6a6-18ee3b873f8b req-8a827d7a-5df7-47d3-930b-fb2243f84d22 service nova] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:29:05.530299 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [req-06f6841d-bbc2-45e2-b6a6-18ee3b873f8b req-8a827d7a-5df7-47d3-930b-fb2243f84d22 service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:29:05.530737 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [req-06f6841d-bbc2-45e2-b6a6-18ee3b873f8b req-8a827d7a-5df7-47d3-930b-fb2243f84d22 service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:29:05.542884 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.compute.server_external_events [req-06f6841d-bbc2-45e2-b6a6-18ee3b873f8b req-8a827d7a-5df7-47d3-930b-fb2243f84d22 service nova] Creating event network-changed:6b41a25b-20b6-415c-930e-d9c6d014f1aa for instance a3be5488-67cf-4a84-ae40-9c0bf189ffd1 on hv-cinder-86309 Oct 31 19:29:05.547695 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [req-06f6841d-bbc2-45e2-b6a6-18ee3b873f8b req-8a827d7a-5df7-47d3-930b-fb2243f84d22 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032099 Oct 31 19:29:05.548288 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 471/938] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 31 19:29:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:29:10.347284 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-3b75278d-667f-4bba-8017-fe396e1d0a0b tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-531213471", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-298495679", "security_groups": [{"name": "tempest-secgroup-smoke-698616685"}], "block_device_mapping_v2": [{"uuid": "21cb00c1-6f6c-4cfd-a52e-5290ee58456b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "adb7c8f5-3156-4d00-ac4d-5e9b81d5fe3b"}]}} {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:29:10.461700 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.network.neutron [None req-3b75278d-667f-4bba-8017-fe396e1d0a0b tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] validate_networks() for [('adb7c8f5-3156-4d00-ac4d-5e9b81d5fe3b', None, None, None, None, None)] {{(pid=118727) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 19:29:11.096156 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.virt.hardware [None req-3b75278d-667f-4bba-8017-fe396e1d0a0b tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Flavor limits 0:0:0 {{(pid=118727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 19:29:11.097191 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.virt.hardware [None req-3b75278d-667f-4bba-8017-fe396e1d0a0b tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Image limits 0:0:0 {{(pid=118727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 19:29:11.097697 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.virt.hardware [None req-3b75278d-667f-4bba-8017-fe396e1d0a0b tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Flavor pref 0:0:0 {{(pid=118727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 19:29:11.098209 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.virt.hardware [None req-3b75278d-667f-4bba-8017-fe396e1d0a0b tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Image pref 0:0:0 {{(pid=118727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 19:29:11.098625 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.virt.hardware [None req-3b75278d-667f-4bba-8017-fe396e1d0a0b tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 19:29:11.107451 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-3b75278d-667f-4bba-8017-fe396e1d0a0b tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:29:11.107944 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-3b75278d-667f-4bba-8017-fe396e1d0a0b tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:29:11.108511 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-3b75278d-667f-4bba-8017-fe396e1d0a0b tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:29:11.109238 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-3b75278d-667f-4bba-8017-fe396e1d0a0b tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:29:11.109720 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-3b75278d-667f-4bba-8017-fe396e1d0a0b tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:29:11.110142 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-3b75278d-667f-4bba-8017-fe396e1d0a0b tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:29:11.126794 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.quota [None req-3b75278d-667f-4bba-8017-fe396e1d0a0b tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Getting quotas for project 808cc3e5392b4bb7a80b154a60f69ee3. Resources: {'instances', 'ram', 'cores'} {{(pid=118727) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 19:29:11.130726 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.quota [None req-3b75278d-667f-4bba-8017-fe396e1d0a0b tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Getting quotas for user 7e73a60801b04fc7acc4260297fdd2e4 and project 808cc3e5392b4bb7a80b154a60f69ee3. Resources: {'instances', 'ram', 'cores'} {{(pid=118727) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 19:29:11.189769 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-3b75278d-667f-4bba-8017-fe396e1d0a0b tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Going to run 1 instances... {{(pid=118727) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 19:29:11.191932 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-3b75278d-667f-4bba-8017-fe396e1d0a0b tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] [instance: 4f58f51e-138f-41b1-80d4-30cc500a9808] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='21cb00c1-6f6c-4cfd-a52e-5290ee58456b',volume_size=None,volume_type=None)] {{(pid=118727) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 19:29:11.334815 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-3b75278d-667f-4bba-8017-fe396e1d0a0b tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.991934 Oct 31 19:29:11.335651 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 468/939] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 31 19:29:10 2022] POST /compute/v2.1/servers => generated 405 bytes in 993 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 19:29:11.347916 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-4a6e4576-e376-4df2-969c-82bceb58dbce tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:29:11.348567 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-4a6e4576-e376-4df2-969c-82bceb58dbce tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] [instance: 4f58f51e-138f-41b1-80d4-30cc500a9808] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:29:11.403587 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-4a6e4576-e376-4df2-969c-82bceb58dbce tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e73a60801b04fc7acc4260297fdd2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808cc3e5392b4bb7a80b154a60f69ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:29:11.410914 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-4a6e4576-e376-4df2-969c-82bceb58dbce tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] 10.222.0.16 "GET /compute/v2.1/servers/4f58f51e-138f-41b1-80d4-30cc500a9808" status: 200 len: 1093 microversion: 2.1 time: 0.067901 Oct 31 19:29:11.411484 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 472/940] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:29:11 2022] GET /compute/v2.1/servers/4f58f51e-138f-41b1-80d4-30cc500a9808 => generated 1093 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 19:29:12.435103 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-ea98d614-2784-4a43-b76b-1c240b658aff tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:29:12.436301 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-ea98d614-2784-4a43-b76b-1c240b658aff tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] [instance: 4f58f51e-138f-41b1-80d4-30cc500a9808] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:29:12.442710 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-ea98d614-2784-4a43-b76b-1c240b658aff tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:29:12.443198 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-ea98d614-2784-4a43-b76b-1c240b658aff tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:29:12.444295 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-ea98d614-2784-4a43-b76b-1c240b658aff tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:29:12.445354 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-ea98d614-2784-4a43-b76b-1c240b658aff tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:29:12.445997 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-ea98d614-2784-4a43-b76b-1c240b658aff tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:29:12.446741 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-ea98d614-2784-4a43-b76b-1c240b658aff tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:29:12.527665 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-ea98d614-2784-4a43-b76b-1c240b658aff tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e73a60801b04fc7acc4260297fdd2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808cc3e5392b4bb7a80b154a60f69ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:29:12.540360 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-ea98d614-2784-4a43-b76b-1c240b658aff tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] 10.222.0.16 "GET /compute/v2.1/servers/4f58f51e-138f-41b1-80d4-30cc500a9808" status: 200 len: 1209 microversion: 2.1 time: 0.109547 Oct 31 19:29:12.542335 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 469/941] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:29:12 2022] GET /compute/v2.1/servers/4f58f51e-138f-41b1-80d4-30cc500a9808 => generated 1209 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:29:13.564374 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-46f9e31f-b9c9-44d2-8aa8-f924dd95007a tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:29:13.565693 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-46f9e31f-b9c9-44d2-8aa8-f924dd95007a tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] [instance: 4f58f51e-138f-41b1-80d4-30cc500a9808] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:29:13.567746 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG dbcounter [-] [118726] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=1 {{(pid=118726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:29:13.574248 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-46f9e31f-b9c9-44d2-8aa8-f924dd95007a tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:29:13.574976 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-46f9e31f-b9c9-44d2-8aa8-f924dd95007a tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:29:13.575599 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-46f9e31f-b9c9-44d2-8aa8-f924dd95007a tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:29:13.576294 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-46f9e31f-b9c9-44d2-8aa8-f924dd95007a tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:29:13.576869 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-46f9e31f-b9c9-44d2-8aa8-f924dd95007a tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:29:13.577301 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-46f9e31f-b9c9-44d2-8aa8-f924dd95007a tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:29:13.730900 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-46f9e31f-b9c9-44d2-8aa8-f924dd95007a tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e73a60801b04fc7acc4260297fdd2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808cc3e5392b4bb7a80b154a60f69ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:29:13.739251 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-46f9e31f-b9c9-44d2-8aa8-f924dd95007a tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] 10.222.0.16 "GET /compute/v2.1/servers/4f58f51e-138f-41b1-80d4-30cc500a9808" status: 200 len: 1264 microversion: 2.1 time: 0.178831 Oct 31 19:29:13.740075 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 473/942] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:29:13 2022] GET /compute/v2.1/servers/4f58f51e-138f-41b1-80d4-30cc500a9808 => generated 1264 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:29:13.940488 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [req-9d0c7fe0-459f-427f-b828-e538222dfbeb req-97abd35b-a602-4658-86bc-0e1b64011d8b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f58f51e-138f-41b1-80d4-30cc500a9808", "tag": "cc59d509-dd78-46f7-93c5-fb58520f4ee4"}]} {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:29:13.945830 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG dbcounter [-] [118727] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=6 {{(pid=118727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:29:13.951692 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [req-9d0c7fe0-459f-427f-b828-e538222dfbeb req-97abd35b-a602-4658-86bc-0e1b64011d8b service nova] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:29:13.952432 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [req-9d0c7fe0-459f-427f-b828-e538222dfbeb req-97abd35b-a602-4658-86bc-0e1b64011d8b service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:29:13.952923 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [req-9d0c7fe0-459f-427f-b828-e538222dfbeb req-97abd35b-a602-4658-86bc-0e1b64011d8b service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:29:13.957903 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG dbcounter [-] [118727] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:29:13.966529 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.compute.server_external_events [req-9d0c7fe0-459f-427f-b828-e538222dfbeb req-97abd35b-a602-4658-86bc-0e1b64011d8b service nova] Creating event network-changed:cc59d509-dd78-46f7-93c5-fb58520f4ee4 for instance 4f58f51e-138f-41b1-80d4-30cc500a9808 on hv-cinder-86309 Oct 31 19:29:13.972419 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [req-9d0c7fe0-459f-427f-b828-e538222dfbeb req-97abd35b-a602-4658-86bc-0e1b64011d8b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034790 Oct 31 19:29:13.973034 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 470/943] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 31 19:29:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:29:14.763866 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-7cc07bc4-339c-4d10-b737-dc81a6f2e74c tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:29:14.764511 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-7cc07bc4-339c-4d10-b737-dc81a6f2e74c tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] [instance: 4f58f51e-138f-41b1-80d4-30cc500a9808] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:29:14.770963 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-7cc07bc4-339c-4d10-b737-dc81a6f2e74c tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:29:14.771448 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-7cc07bc4-339c-4d10-b737-dc81a6f2e74c tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:29:14.771882 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-7cc07bc4-339c-4d10-b737-dc81a6f2e74c tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:29:14.772578 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-7cc07bc4-339c-4d10-b737-dc81a6f2e74c tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:29:14.773035 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-7cc07bc4-339c-4d10-b737-dc81a6f2e74c tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:29:14.773460 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-7cc07bc4-339c-4d10-b737-dc81a6f2e74c tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:29:14.928683 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-7cc07bc4-339c-4d10-b737-dc81a6f2e74c tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e73a60801b04fc7acc4260297fdd2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808cc3e5392b4bb7a80b154a60f69ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:29:14.936563 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-7cc07bc4-339c-4d10-b737-dc81a6f2e74c tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] 10.222.0.16 "GET /compute/v2.1/servers/4f58f51e-138f-41b1-80d4-30cc500a9808" status: 200 len: 1264 microversion: 2.1 time: 0.176546 Oct 31 19:29:14.937346 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 474/944] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:29:14 2022] GET /compute/v2.1/servers/4f58f51e-138f-41b1-80d4-30cc500a9808 => generated 1264 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 19:29:15.965158 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-399c30c7-2461-4fd3-b410-3ed850b14fba tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:29:15.965892 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-399c30c7-2461-4fd3-b410-3ed850b14fba tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] [instance: 4f58f51e-138f-41b1-80d4-30cc500a9808] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:29:15.972736 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-399c30c7-2461-4fd3-b410-3ed850b14fba tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:29:15.973215 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-399c30c7-2461-4fd3-b410-3ed850b14fba tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:29:15.973661 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-399c30c7-2461-4fd3-b410-3ed850b14fba tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:29:15.974379 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-399c30c7-2461-4fd3-b410-3ed850b14fba tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:29:15.974945 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-399c30c7-2461-4fd3-b410-3ed850b14fba tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:29:15.975371 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-399c30c7-2461-4fd3-b410-3ed850b14fba tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:29:16.108455 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-399c30c7-2461-4fd3-b410-3ed850b14fba tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e73a60801b04fc7acc4260297fdd2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808cc3e5392b4bb7a80b154a60f69ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:29:16.116178 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-399c30c7-2461-4fd3-b410-3ed850b14fba tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] 10.222.0.16 "GET /compute/v2.1/servers/4f58f51e-138f-41b1-80d4-30cc500a9808" status: 200 len: 1264 microversion: 2.1 time: 0.159096 Oct 31 19:29:16.116750 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 471/945] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:29:15 2022] GET /compute/v2.1/servers/4f58f51e-138f-41b1-80d4-30cc500a9808 => generated 1264 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:29:17.139163 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-2af11804-641a-4ff6-89e3-07bbea051e24 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:29:17.139780 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-2af11804-641a-4ff6-89e3-07bbea051e24 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] [instance: 4f58f51e-138f-41b1-80d4-30cc500a9808] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:29:17.146812 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-2af11804-641a-4ff6-89e3-07bbea051e24 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:29:17.147301 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-2af11804-641a-4ff6-89e3-07bbea051e24 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:29:17.147741 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-2af11804-641a-4ff6-89e3-07bbea051e24 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:29:17.148434 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-2af11804-641a-4ff6-89e3-07bbea051e24 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:29:17.148910 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-2af11804-641a-4ff6-89e3-07bbea051e24 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:29:17.149374 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-2af11804-641a-4ff6-89e3-07bbea051e24 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:29:17.290980 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-2af11804-641a-4ff6-89e3-07bbea051e24 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e73a60801b04fc7acc4260297fdd2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808cc3e5392b4bb7a80b154a60f69ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:29:17.300263 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-2af11804-641a-4ff6-89e3-07bbea051e24 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] 10.222.0.16 "GET /compute/v2.1/servers/4f58f51e-138f-41b1-80d4-30cc500a9808" status: 200 len: 1264 microversion: 2.1 time: 0.164949 Oct 31 19:29:17.300830 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 475/946] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:29:17 2022] GET /compute/v2.1/servers/4f58f51e-138f-41b1-80d4-30cc500a9808 => generated 1264 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 19:29:18.323355 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-18c69797-936b-4f8c-b24c-75758de75dbf tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:29:18.323976 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-18c69797-936b-4f8c-b24c-75758de75dbf tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] [instance: 4f58f51e-138f-41b1-80d4-30cc500a9808] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:29:18.330350 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-18c69797-936b-4f8c-b24c-75758de75dbf tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:29:18.331366 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-18c69797-936b-4f8c-b24c-75758de75dbf tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:29:18.331803 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-18c69797-936b-4f8c-b24c-75758de75dbf tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:29:18.332500 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-18c69797-936b-4f8c-b24c-75758de75dbf tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:29:18.332956 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-18c69797-936b-4f8c-b24c-75758de75dbf tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:29:18.333387 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-18c69797-936b-4f8c-b24c-75758de75dbf tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:29:18.472945 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-18c69797-936b-4f8c-b24c-75758de75dbf tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e73a60801b04fc7acc4260297fdd2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808cc3e5392b4bb7a80b154a60f69ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:29:18.481499 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-18c69797-936b-4f8c-b24c-75758de75dbf tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] 10.222.0.16 "GET /compute/v2.1/servers/4f58f51e-138f-41b1-80d4-30cc500a9808" status: 200 len: 1264 microversion: 2.1 time: 0.162084 Oct 31 19:29:18.482284 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 472/947] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:29:18 2022] GET /compute/v2.1/servers/4f58f51e-138f-41b1-80d4-30cc500a9808 => generated 1264 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:29:19.505339 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-4c9de4af-6453-49ca-854a-3fe2f3925f5c tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:29:19.505978 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-4c9de4af-6453-49ca-854a-3fe2f3925f5c tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] [instance: 4f58f51e-138f-41b1-80d4-30cc500a9808] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:29:19.512416 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-4c9de4af-6453-49ca-854a-3fe2f3925f5c tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:29:19.512898 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-4c9de4af-6453-49ca-854a-3fe2f3925f5c tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:29:19.513327 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-4c9de4af-6453-49ca-854a-3fe2f3925f5c tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:29:19.514072 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-4c9de4af-6453-49ca-854a-3fe2f3925f5c tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:29:19.514524 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-4c9de4af-6453-49ca-854a-3fe2f3925f5c tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:29:19.514944 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-4c9de4af-6453-49ca-854a-3fe2f3925f5c tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:29:19.645076 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-4c9de4af-6453-49ca-854a-3fe2f3925f5c tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e73a60801b04fc7acc4260297fdd2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808cc3e5392b4bb7a80b154a60f69ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:29:19.652889 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-4c9de4af-6453-49ca-854a-3fe2f3925f5c tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] 10.222.0.16 "GET /compute/v2.1/servers/4f58f51e-138f-41b1-80d4-30cc500a9808" status: 200 len: 1264 microversion: 2.1 time: 0.152086 Oct 31 19:29:19.653549 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 476/948] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:29:19 2022] GET /compute/v2.1/servers/4f58f51e-138f-41b1-80d4-30cc500a9808 => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:29:20.678144 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-5de7e1a0-ad28-4bff-8d59-73ac58dd4404 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:29:20.678768 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-5de7e1a0-ad28-4bff-8d59-73ac58dd4404 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] [instance: 4f58f51e-138f-41b1-80d4-30cc500a9808] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:29:20.686374 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-5de7e1a0-ad28-4bff-8d59-73ac58dd4404 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:29:20.686863 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-5de7e1a0-ad28-4bff-8d59-73ac58dd4404 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:29:20.687332 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-5de7e1a0-ad28-4bff-8d59-73ac58dd4404 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:29:20.688125 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-5de7e1a0-ad28-4bff-8d59-73ac58dd4404 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:29:20.688611 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-5de7e1a0-ad28-4bff-8d59-73ac58dd4404 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:29:20.689308 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-5de7e1a0-ad28-4bff-8d59-73ac58dd4404 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:29:20.835621 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-5de7e1a0-ad28-4bff-8d59-73ac58dd4404 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e73a60801b04fc7acc4260297fdd2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808cc3e5392b4bb7a80b154a60f69ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:29:20.843439 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-5de7e1a0-ad28-4bff-8d59-73ac58dd4404 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] 10.222.0.16 "GET /compute/v2.1/servers/4f58f51e-138f-41b1-80d4-30cc500a9808" status: 200 len: 1264 microversion: 2.1 time: 0.170082 Oct 31 19:29:20.844099 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 473/949] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:29:20 2022] GET /compute/v2.1/servers/4f58f51e-138f-41b1-80d4-30cc500a9808 => generated 1264 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 19:29:21.867207 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-5f007b62-38da-40ba-a4a0-24e7103aa7d9 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:29:21.867822 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-5f007b62-38da-40ba-a4a0-24e7103aa7d9 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] [instance: 4f58f51e-138f-41b1-80d4-30cc500a9808] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:29:21.871926 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG dbcounter [-] [118726] Writing DB stats nova_cell0:SELECT=2 {{(pid=118726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:29:21.886345 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-5f007b62-38da-40ba-a4a0-24e7103aa7d9 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:29:21.887953 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-5f007b62-38da-40ba-a4a0-24e7103aa7d9 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:29:21.888340 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-5f007b62-38da-40ba-a4a0-24e7103aa7d9 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:29:21.889037 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-5f007b62-38da-40ba-a4a0-24e7103aa7d9 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:29:21.889725 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-5f007b62-38da-40ba-a4a0-24e7103aa7d9 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:29:21.890132 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-5f007b62-38da-40ba-a4a0-24e7103aa7d9 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:29:22.026987 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-5f007b62-38da-40ba-a4a0-24e7103aa7d9 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e73a60801b04fc7acc4260297fdd2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808cc3e5392b4bb7a80b154a60f69ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:29:22.034802 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-5f007b62-38da-40ba-a4a0-24e7103aa7d9 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] 10.222.0.16 "GET /compute/v2.1/servers/4f58f51e-138f-41b1-80d4-30cc500a9808" status: 200 len: 1264 microversion: 2.1 time: 0.171944 Oct 31 19:29:22.035368 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 477/950] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:29:21 2022] GET /compute/v2.1/servers/4f58f51e-138f-41b1-80d4-30cc500a9808 => generated 1264 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:29:23.057725 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-c0b598e5-ae8f-4de2-a196-7dea9d7b8cb9 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:29:23.058345 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-c0b598e5-ae8f-4de2-a196-7dea9d7b8cb9 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] [instance: 4f58f51e-138f-41b1-80d4-30cc500a9808] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:29:23.060294 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG dbcounter [-] [118727] Writing DB stats nova_cell0:SELECT=2 {{(pid=118727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:29:23.061111 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG dbcounter [-] [118727] Writing DB stats nova_cell0:SELECT=6 {{(pid=118727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:29:23.068575 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-c0b598e5-ae8f-4de2-a196-7dea9d7b8cb9 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:29:23.069065 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-c0b598e5-ae8f-4de2-a196-7dea9d7b8cb9 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:29:23.069558 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-c0b598e5-ae8f-4de2-a196-7dea9d7b8cb9 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:29:23.070232 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-c0b598e5-ae8f-4de2-a196-7dea9d7b8cb9 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:29:23.070696 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-c0b598e5-ae8f-4de2-a196-7dea9d7b8cb9 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:29:23.071125 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-c0b598e5-ae8f-4de2-a196-7dea9d7b8cb9 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:29:23.202077 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-c0b598e5-ae8f-4de2-a196-7dea9d7b8cb9 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e73a60801b04fc7acc4260297fdd2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808cc3e5392b4bb7a80b154a60f69ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:29:23.209517 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-c0b598e5-ae8f-4de2-a196-7dea9d7b8cb9 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] 10.222.0.16 "GET /compute/v2.1/servers/4f58f51e-138f-41b1-80d4-30cc500a9808" status: 200 len: 1264 microversion: 2.1 time: 0.155747 Oct 31 19:29:23.210116 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 474/951] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:29:23 2022] GET /compute/v2.1/servers/4f58f51e-138f-41b1-80d4-30cc500a9808 => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:29:24.232240 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-03465820-e3b5-4e8f-b0e1-037a1c9fef2e tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:29:24.232944 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-03465820-e3b5-4e8f-b0e1-037a1c9fef2e tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] [instance: 4f58f51e-138f-41b1-80d4-30cc500a9808] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:29:24.240465 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-03465820-e3b5-4e8f-b0e1-037a1c9fef2e tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:29:24.240950 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-03465820-e3b5-4e8f-b0e1-037a1c9fef2e tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:29:24.241389 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-03465820-e3b5-4e8f-b0e1-037a1c9fef2e tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:29:24.242119 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-03465820-e3b5-4e8f-b0e1-037a1c9fef2e tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:29:24.242578 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-03465820-e3b5-4e8f-b0e1-037a1c9fef2e tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:29:24.243008 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-03465820-e3b5-4e8f-b0e1-037a1c9fef2e tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:29:24.245549 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG dbcounter [-] [118726] Writing DB stats nova_cell1:SELECT=65 {{(pid=118726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:29:24.377621 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-03465820-e3b5-4e8f-b0e1-037a1c9fef2e tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e73a60801b04fc7acc4260297fdd2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808cc3e5392b4bb7a80b154a60f69ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:29:24.385305 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-03465820-e3b5-4e8f-b0e1-037a1c9fef2e tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] 10.222.0.16 "GET /compute/v2.1/servers/4f58f51e-138f-41b1-80d4-30cc500a9808" status: 200 len: 1264 microversion: 2.1 time: 0.157172 Oct 31 19:29:24.385894 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 478/952] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:29:24 2022] GET /compute/v2.1/servers/4f58f51e-138f-41b1-80d4-30cc500a9808 => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:29:24.586624 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [req-c83973d2-52d7-4cb9-be37-a7694ceb769e req-5fe69172-142d-4cb0-863e-286657dd1cd2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f58f51e-138f-41b1-80d4-30cc500a9808", "name": "network-vif-plugged", "status": "completed", "tag": "cc59d509-dd78-46f7-93c5-fb58520f4ee4"}]} {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:29:24.595900 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [req-c83973d2-52d7-4cb9-be37-a7694ceb769e req-5fe69172-142d-4cb0-863e-286657dd1cd2 service nova] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:29:24.596560 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [req-c83973d2-52d7-4cb9-be37-a7694ceb769e req-5fe69172-142d-4cb0-863e-286657dd1cd2 service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:29:24.597563 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [req-c83973d2-52d7-4cb9-be37-a7694ceb769e req-5fe69172-142d-4cb0-863e-286657dd1cd2 service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:29:24.611322 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.compute.server_external_events [req-c83973d2-52d7-4cb9-be37-a7694ceb769e req-5fe69172-142d-4cb0-863e-286657dd1cd2 service nova] Creating event network-vif-plugged:cc59d509-dd78-46f7-93c5-fb58520f4ee4 for instance 4f58f51e-138f-41b1-80d4-30cc500a9808 on hv-cinder-86309 Oct 31 19:29:24.616231 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [req-c83973d2-52d7-4cb9-be37-a7694ceb769e req-5fe69172-142d-4cb0-863e-286657dd1cd2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033550 Oct 31 19:29:24.616819 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 475/953] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 31 19:29:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:29:25.408847 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-922492fa-750e-4df9-95bc-66ef9e35615a tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:29:25.409498 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-922492fa-750e-4df9-95bc-66ef9e35615a tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] [instance: 4f58f51e-138f-41b1-80d4-30cc500a9808] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:29:25.416446 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-922492fa-750e-4df9-95bc-66ef9e35615a tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:29:25.416911 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-922492fa-750e-4df9-95bc-66ef9e35615a tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:29:25.417344 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-922492fa-750e-4df9-95bc-66ef9e35615a tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:29:25.418072 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-922492fa-750e-4df9-95bc-66ef9e35615a tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:29:25.418529 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-922492fa-750e-4df9-95bc-66ef9e35615a tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:29:25.419154 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-922492fa-750e-4df9-95bc-66ef9e35615a tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:29:25.591174 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-922492fa-750e-4df9-95bc-66ef9e35615a tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e73a60801b04fc7acc4260297fdd2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808cc3e5392b4bb7a80b154a60f69ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:29:25.599787 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-922492fa-750e-4df9-95bc-66ef9e35615a tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] 10.222.0.16 "GET /compute/v2.1/servers/4f58f51e-138f-41b1-80d4-30cc500a9808" status: 200 len: 1264 microversion: 2.1 time: 0.194767 Oct 31 19:29:25.600857 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 479/954] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:29:25 2022] GET /compute/v2.1/servers/4f58f51e-138f-41b1-80d4-30cc500a9808 => generated 1264 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:29:26.624898 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-8d6ba507-399e-40f7-8fa1-9e529c9c7d26 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:29:26.625614 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-8d6ba507-399e-40f7-8fa1-9e529c9c7d26 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] [instance: 4f58f51e-138f-41b1-80d4-30cc500a9808] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:29:26.632457 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-8d6ba507-399e-40f7-8fa1-9e529c9c7d26 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:29:26.632948 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-8d6ba507-399e-40f7-8fa1-9e529c9c7d26 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:29:26.633383 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-8d6ba507-399e-40f7-8fa1-9e529c9c7d26 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:29:26.634108 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-8d6ba507-399e-40f7-8fa1-9e529c9c7d26 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:29:26.634566 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-8d6ba507-399e-40f7-8fa1-9e529c9c7d26 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:29:26.634990 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-8d6ba507-399e-40f7-8fa1-9e529c9c7d26 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:29:26.775749 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-8d6ba507-399e-40f7-8fa1-9e529c9c7d26 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e73a60801b04fc7acc4260297fdd2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808cc3e5392b4bb7a80b154a60f69ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:29:26.783474 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-8d6ba507-399e-40f7-8fa1-9e529c9c7d26 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] 10.222.0.16 "GET /compute/v2.1/servers/4f58f51e-138f-41b1-80d4-30cc500a9808" status: 200 len: 1450 microversion: 2.1 time: 0.163660 Oct 31 19:29:26.784064 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 476/955] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:29:26 2022] GET /compute/v2.1/servers/4f58f51e-138f-41b1-80d4-30cc500a9808 => generated 1450 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:29:26.807895 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-36de6dbd-ac2b-4bc1-9174-27a74d9abc8a tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:29:26.808515 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-36de6dbd-ac2b-4bc1-9174-27a74d9abc8a tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] [instance: 4f58f51e-138f-41b1-80d4-30cc500a9808] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:29:26.816880 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-36de6dbd-ac2b-4bc1-9174-27a74d9abc8a tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:29:26.817478 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-36de6dbd-ac2b-4bc1-9174-27a74d9abc8a tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:29:26.817936 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-36de6dbd-ac2b-4bc1-9174-27a74d9abc8a tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:29:26.818628 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-36de6dbd-ac2b-4bc1-9174-27a74d9abc8a tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:29:26.819080 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-36de6dbd-ac2b-4bc1-9174-27a74d9abc8a tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:29:26.819530 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-36de6dbd-ac2b-4bc1-9174-27a74d9abc8a tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:29:26.970527 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-36de6dbd-ac2b-4bc1-9174-27a74d9abc8a tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e73a60801b04fc7acc4260297fdd2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808cc3e5392b4bb7a80b154a60f69ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:29:26.984800 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-36de6dbd-ac2b-4bc1-9174-27a74d9abc8a tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] 10.222.0.16 "GET /compute/v2.1/servers/4f58f51e-138f-41b1-80d4-30cc500a9808" status: 200 len: 1450 microversion: 2.1 time: 0.181311 Oct 31 19:29:26.993101 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 480/956] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:29:26 2022] GET /compute/v2.1/servers/4f58f51e-138f-41b1-80d4-30cc500a9808 => generated 1450 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:29:28.954170 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [req-c7a086fb-581e-4cdf-87ae-a0d8faf827d2 req-1c66ab93-a4b3-445d-bca9-86d87001fca0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f58f51e-138f-41b1-80d4-30cc500a9808", "tag": "cc59d509-dd78-46f7-93c5-fb58520f4ee4"}]} {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:29:28.964837 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [req-c7a086fb-581e-4cdf-87ae-a0d8faf827d2 req-1c66ab93-a4b3-445d-bca9-86d87001fca0 service nova] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:29:28.965468 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [req-c7a086fb-581e-4cdf-87ae-a0d8faf827d2 req-1c66ab93-a4b3-445d-bca9-86d87001fca0 service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:29:28.966161 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [req-c7a086fb-581e-4cdf-87ae-a0d8faf827d2 req-1c66ab93-a4b3-445d-bca9-86d87001fca0 service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:29:28.979347 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.compute.server_external_events [req-c7a086fb-581e-4cdf-87ae-a0d8faf827d2 req-1c66ab93-a4b3-445d-bca9-86d87001fca0 service nova] Creating event network-changed:cc59d509-dd78-46f7-93c5-fb58520f4ee4 for instance 4f58f51e-138f-41b1-80d4-30cc500a9808 on hv-cinder-86309 Oct 31 19:29:28.984439 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [req-c7a086fb-581e-4cdf-87ae-a0d8faf827d2 req-1c66ab93-a4b3-445d-bca9-86d87001fca0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033836 Oct 31 19:29:28.985213 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 477/957] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 31 19:29:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:29:49.351805 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-e22df6ed-bfc2-46e2-b092-c9ade94259b4 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:29:49.352403 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-e22df6ed-bfc2-46e2-b092-c9ade94259b4 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] [instance: a3be5488-67cf-4a84-ae40-9c0bf189ffd1] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:29:49.354267 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG dbcounter [-] [118726] Writing DB stats nova_api:SELECT=15 {{(pid=118726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:29:49.355097 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG dbcounter [-] [118726] Writing DB stats nova_cell1:SELECT=17 {{(pid=118726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:29:49.361098 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-e22df6ed-bfc2-46e2-b092-c9ade94259b4 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:29:49.361585 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-e22df6ed-bfc2-46e2-b092-c9ade94259b4 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:29:49.362050 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-e22df6ed-bfc2-46e2-b092-c9ade94259b4 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:29:49.362744 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-e22df6ed-bfc2-46e2-b092-c9ade94259b4 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:29:49.363203 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-e22df6ed-bfc2-46e2-b092-c9ade94259b4 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:29:49.363630 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-e22df6ed-bfc2-46e2-b092-c9ade94259b4 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:29:49.386428 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-e22df6ed-bfc2-46e2-b092-c9ade94259b4 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] 10.222.0.16 "GET /compute/v2.1/servers/a3be5488-67cf-4a84-ae40-9c0bf189ffd1/ips" status: 200 len: 149 microversion: 2.1 time: 0.039212 Oct 31 19:29:49.386987 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 481/958] 10.222.0.16 () {58 vars in 1248 bytes} [Mon Oct 31 19:29:49 2022] GET /compute/v2.1/servers/a3be5488-67cf-4a84-ae40-9c0bf189ffd1/ips => generated 149 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 19:29:49.400186 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-94320ba7-bd93-43fa-b58a-371d6e36d17f tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dfda8425-9a81-4cdc-b619-1b0eb87b9e95"}} {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:29:49.402613 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-94320ba7-bd93-43fa-b58a-371d6e36d17f tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] [instance: a3be5488-67cf-4a84-ae40-9c0bf189ffd1] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:29:49.405202 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG dbcounter [-] [118727] Writing DB stats nova_api:SELECT=15 {{(pid=118727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:29:49.405875 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG dbcounter [-] [118727] Writing DB stats nova_cell1:SELECT=35 {{(pid=118727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:29:49.411617 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-94320ba7-bd93-43fa-b58a-371d6e36d17f tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:29:49.412748 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-94320ba7-bd93-43fa-b58a-371d6e36d17f tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:29:49.413182 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-94320ba7-bd93-43fa-b58a-371d6e36d17f tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:29:49.413907 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-94320ba7-bd93-43fa-b58a-371d6e36d17f tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:29:49.414626 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-94320ba7-bd93-43fa-b58a-371d6e36d17f tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:29:49.415052 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-94320ba7-bd93-43fa-b58a-371d6e36d17f tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:29:49.492422 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.wsgi [None req-94320ba7-bd93-43fa-b58a-371d6e36d17f tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] HTTP exception thrown: Invalid volume: volume dfda8425-9a81-4cdc-b619-1b0eb87b9e95 is already attached to instances: 1fd43154-badc-47b6-a5a7-d1f28e759bb0 Oct 31 19:29:49.494174 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-94320ba7-bd93-43fa-b58a-371d6e36d17f tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Request method failure captured: Oct 31 19:29:49.494174 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: request: POST /compute/v2.1/servers/a3be5488-67cf-4a84-ae40-9c0bf189ffd1/os-volume_attachments HTTP/1.1 Oct 31 19:29:49.494174 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Accept: application/json Oct 31 19:29:49.494174 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Accept-Encoding: identity Oct 31 19:29:49.494174 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Connection: close Oct 31 19:29:49.494174 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Content-Length: 74 Oct 31 19:29:49.494174 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Content-Type: application/json Oct 31 19:29:49.494174 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Host: 10.222.0.16 Oct 31 19:29:49.494174 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Openstack-System-Scope: None Oct 31 19:29:49.494174 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: User-Agent: python-urllib3/1.26.12 Oct 31 19:29:49.494174 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Auth-Token: gAAAAABjYCG5aDHxCXWKl54hrIP8uylj79sP0BDeZd_ckOPD9KTXbM2ReEx2xP85m13HtVq0_y1CIML9YTOWHjoWbtPsbViKMinP0f-u0wr8bnwCjlILH4aKfybx_z4WSYI8NEE_nzlMlhmG0HnRtdfd3ZDvw9RFGweGeDxD4VM0dXtgMk2CUO4 Oct 31 19:29:49.494174 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Domain-Id: None Oct 31 19:29:49.494174 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Domain-Name: None Oct 31 19:29:49.494174 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Identity-Status: Confirmed Oct 31 19:29:49.494174 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Is-Admin-Project: True Oct 31 19:29:49.494174 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Project-Domain-Id: default Oct 31 19:29:49.494174 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Project-Domain-Name: Default Oct 31 19:29:49.494174 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Project-Id: adba9bc456234ea6ade63d41a1624967 Oct 31 19:29:49.494174 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Project-Name: tempest-AttachVolumeNegativeTest-1656947587 Oct 31 19:29:49.494174 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Role: member,reader Oct 31 19:29:49.494174 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Roles: member,reader Oct 31 19:29:49.495876 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/adba9bc456234ea6ade63d41a1624967"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_adba9bc456234ea6ade63d41a1624967", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/adba9bc456234ea6ade63d41a1624967"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/adba9bc456234ea6ade63d41a1624967"}]}] Oct 31 19:29:49.495876 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Tenant: tempest-AttachVolumeNegativeTest-1656947587 Oct 31 19:29:49.495876 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Tenant-Id: adba9bc456234ea6ade63d41a1624967 Oct 31 19:29:49.495876 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1656947587 Oct 31 19:29:49.495876 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User: tempest-AttachVolumeNegativeTest-1656947587-project Oct 31 19:29:49.495876 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User-Domain-Id: default Oct 31 19:29:49.495876 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User-Domain-Name: Default Oct 31 19:29:49.495876 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User-Id: 16778b0dd21d41eeaa6087b67931eef8 Oct 31 19:29:49.495876 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User-Name: tempest-AttachVolumeNegativeTest-1656947587-project Oct 31 19:29:49.495876 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Oct 31 19:29:49.495876 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: {"volumeAttachment": {"volumeId": "dfda8425-9a81-4cdc-b619-1b0eb87b9e95"}} Oct 31 19:29:49.495876 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: method: > Oct 31 19:29:49.496943 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: exception: Invalid volume: volume dfda8425-9a81-4cdc-b619-1b0eb87b9e95 is already attached to instances: 1fd43154-badc-47b6-a5a7-d1f28e759bb0 Oct 31 19:29:49.496943 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: action_args: {'server_id': 'a3be5488-67cf-4a84-ae40-9c0bf189ffd1', 'body': {'volumeAttachment': {'volumeId': 'dfda8425-9a81-4cdc-b619-1b0eb87b9e95'}}} Oct 31 19:29:49.496943 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 19:29:49.496943 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:29:49.496943 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 31 19:29:49.496943 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 31 19:29:49.496943 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 31 19:29:49.496943 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 31 19:29:49.496943 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 31 19:29:49.496943 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 31 19:29:49.496943 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 31 19:29:49.496943 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 31 19:29:49.496943 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 31 19:29:49.496943 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 31 19:29:49.496943 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume dfda8425-9a81-4cdc-b619-1b0eb87b9e95 is already attached to instances: 1fd43154-badc-47b6-a5a7-d1f28e759bb0 Oct 31 19:29:49.496943 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:29:49.496943 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 19:29:49.496943 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:29:49.496943 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:29:49.498551 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 19:29:49.498551 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 19:29:49.498551 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 19:29:49.498551 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 19:29:49.498551 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 19:29:49.498551 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 19:29:49.498551 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 19:29:49.498551 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 19:29:49.498551 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 19:29:49.498551 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 19:29:49.498551 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 19:29:49.498551 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 19:29:49.498551 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 31 19:29:49.498551 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 31 19:29:49.498551 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume dfda8425-9a81-4cdc-b619-1b0eb87b9e95 is already attached to instances: 1fd43154-badc-47b6-a5a7-d1f28e759bb0 Oct 31 19:29:49.498551 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:29:49.498551 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 19:29:49.498551 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:29:49.498551 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:29:49.498551 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 19:29:49.500215 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 19:29:49.500215 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 19:29:49.500215 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 19:29:49.500215 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume dfda8425-9a81-4cdc-b619-1b0eb87b9e95 is already attached to instances: 1fd43154-badc-47b6-a5a7-d1f28e759bb0 Oct 31 19:29:49.500215 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:29:49.500215 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-94320ba7-bd93-43fa-b58a-371d6e36d17f tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Returning 400 to user: Invalid volume: volume dfda8425-9a81-4cdc-b619-1b0eb87b9e95 is already attached to instances: 1fd43154-badc-47b6-a5a7-d1f28e759bb0 {{(pid=118727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 19:29:49.500215 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-94320ba7-bd93-43fa-b58a-371d6e36d17f tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] 10.222.0.16 "POST /compute/v2.1/servers/a3be5488-67cf-4a84-ae40-9c0bf189ffd1/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.100263 Oct 31 19:29:49.500215 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 478/959] 10.222.0.16 () {60 vars in 1323 bytes} [Mon Oct 31 19:29:49 2022] POST /compute/v2.1/servers/a3be5488-67cf-4a84-ae40-9c0bf189ffd1/os-volume_attachments => generated 174 bytes in 101 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 31 19:29:49.504392 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-c2ab9f0f-3076-417b-a94c-22dc3c3a6a3b tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:29:49.504999 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-c2ab9f0f-3076-417b-a94c-22dc3c3a6a3b tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] [instance: a3be5488-67cf-4a84-ae40-9c0bf189ffd1] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:29:49.511656 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-c2ab9f0f-3076-417b-a94c-22dc3c3a6a3b tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:29:49.512137 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-c2ab9f0f-3076-417b-a94c-22dc3c3a6a3b tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:29:49.512570 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-c2ab9f0f-3076-417b-a94c-22dc3c3a6a3b tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:29:49.513252 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-c2ab9f0f-3076-417b-a94c-22dc3c3a6a3b tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:29:49.513733 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-c2ab9f0f-3076-417b-a94c-22dc3c3a6a3b tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:29:49.514154 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-c2ab9f0f-3076-417b-a94c-22dc3c3a6a3b tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:29:49.539635 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-c2ab9f0f-3076-417b-a94c-22dc3c3a6a3b tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] [instance: a3be5488-67cf-4a84-ae40-9c0bf189ffd1] Going to try to terminate instance {{(pid=118726) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 19:29:49.612142 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-c2ab9f0f-3076-417b-a94c-22dc3c3a6a3b tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] 10.222.0.16 "DELETE /compute/v2.1/servers/a3be5488-67cf-4a84-ae40-9c0bf189ffd1" status: 204 len: 0 microversion: 2.1 time: 0.111196 Oct 31 19:29:49.612837 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 482/960] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 31 19:29:49 2022] DELETE /compute/v2.1/servers/a3be5488-67cf-4a84-ae40-9c0bf189ffd1 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 19:29:49.621260 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-7394bca8-b26c-44ed-9679-a508cf4ded50 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:29:49.621905 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-7394bca8-b26c-44ed-9679-a508cf4ded50 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] [instance: a3be5488-67cf-4a84-ae40-9c0bf189ffd1] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:29:49.628440 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-7394bca8-b26c-44ed-9679-a508cf4ded50 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:29:49.628922 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-7394bca8-b26c-44ed-9679-a508cf4ded50 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:29:49.629355 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-7394bca8-b26c-44ed-9679-a508cf4ded50 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:29:49.630077 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-7394bca8-b26c-44ed-9679-a508cf4ded50 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:29:49.630533 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-7394bca8-b26c-44ed-9679-a508cf4ded50 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:29:49.631447 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-7394bca8-b26c-44ed-9679-a508cf4ded50 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:29:49.764477 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-7394bca8-b26c-44ed-9679-a508cf4ded50 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16778b0dd21d41eeaa6087b67931eef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba9bc456234ea6ade63d41a1624967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:29:49.773324 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-7394bca8-b26c-44ed-9679-a508cf4ded50 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] 10.222.0.16 "GET /compute/v2.1/servers/a3be5488-67cf-4a84-ae40-9c0bf189ffd1" status: 200 len: 1682 microversion: 2.1 time: 0.155957 Oct 31 19:29:49.773911 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 479/961] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:29:49 2022] GET /compute/v2.1/servers/a3be5488-67cf-4a84-ae40-9c0bf189ffd1 => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:29:50.796861 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-127acda1-fbbb-41e1-9b60-d7d80aaf8247 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:29:50.797483 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-127acda1-fbbb-41e1-9b60-d7d80aaf8247 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] [instance: a3be5488-67cf-4a84-ae40-9c0bf189ffd1] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:29:50.803806 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-127acda1-fbbb-41e1-9b60-d7d80aaf8247 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:29:50.804277 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-127acda1-fbbb-41e1-9b60-d7d80aaf8247 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:29:50.804701 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-127acda1-fbbb-41e1-9b60-d7d80aaf8247 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:29:50.805384 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-127acda1-fbbb-41e1-9b60-d7d80aaf8247 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:29:50.805864 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-127acda1-fbbb-41e1-9b60-d7d80aaf8247 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:29:50.806285 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-127acda1-fbbb-41e1-9b60-d7d80aaf8247 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:29:50.935081 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-127acda1-fbbb-41e1-9b60-d7d80aaf8247 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16778b0dd21d41eeaa6087b67931eef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba9bc456234ea6ade63d41a1624967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:29:50.942687 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-127acda1-fbbb-41e1-9b60-d7d80aaf8247 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] 10.222.0.16 "GET /compute/v2.1/servers/a3be5488-67cf-4a84-ae40-9c0bf189ffd1" status: 200 len: 1682 microversion: 2.1 time: 0.150103 Oct 31 19:29:50.943776 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 483/962] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:29:50 2022] GET /compute/v2.1/servers/a3be5488-67cf-4a84-ae40-9c0bf189ffd1 => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 19:29:51.966506 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-6e0a7b5f-d77d-433c-aaba-569066de169f tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:29:51.967290 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-6e0a7b5f-d77d-433c-aaba-569066de169f tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] [instance: a3be5488-67cf-4a84-ae40-9c0bf189ffd1] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:29:51.973933 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-6e0a7b5f-d77d-433c-aaba-569066de169f tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:29:51.974927 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-6e0a7b5f-d77d-433c-aaba-569066de169f tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:29:51.975505 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-6e0a7b5f-d77d-433c-aaba-569066de169f tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:29:51.976196 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-6e0a7b5f-d77d-433c-aaba-569066de169f tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:29:51.976644 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-6e0a7b5f-d77d-433c-aaba-569066de169f tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:29:51.977060 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-6e0a7b5f-d77d-433c-aaba-569066de169f tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:29:52.052244 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-6e0a7b5f-d77d-433c-aaba-569066de169f tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16778b0dd21d41eeaa6087b67931eef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba9bc456234ea6ade63d41a1624967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:29:52.061338 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-6e0a7b5f-d77d-433c-aaba-569066de169f tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] 10.222.0.16 "GET /compute/v2.1/servers/a3be5488-67cf-4a84-ae40-9c0bf189ffd1" status: 200 len: 1614 microversion: 2.1 time: 0.098979 Oct 31 19:29:52.061971 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 480/963] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:29:51 2022] GET /compute/v2.1/servers/a3be5488-67cf-4a84-ae40-9c0bf189ffd1 => generated 1614 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:29:52.119732 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [req-6528f28a-690b-4fab-9a50-8b64604234df req-c7374bbb-56b1-49ea-9da2-e6d1ec36a1d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3be5488-67cf-4a84-ae40-9c0bf189ffd1", "name": "network-vif-deleted", "tag": "6b41a25b-20b6-415c-930e-d9c6d014f1aa"}]} {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:29:52.135417 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [req-6528f28a-690b-4fab-9a50-8b64604234df req-c7374bbb-56b1-49ea-9da2-e6d1ec36a1d1 service nova] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:29:52.135902 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [req-6528f28a-690b-4fab-9a50-8b64604234df req-c7374bbb-56b1-49ea-9da2-e6d1ec36a1d1 service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:29:52.136337 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [req-6528f28a-690b-4fab-9a50-8b64604234df req-c7374bbb-56b1-49ea-9da2-e6d1ec36a1d1 service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:29:52.154166 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.compute.server_external_events [req-6528f28a-690b-4fab-9a50-8b64604234df req-c7374bbb-56b1-49ea-9da2-e6d1ec36a1d1 service nova] Creating event network-vif-deleted:6b41a25b-20b6-415c-930e-d9c6d014f1aa for instance a3be5488-67cf-4a84-ae40-9c0bf189ffd1 on hv-cinder-86309 Oct 31 19:29:52.162477 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [req-6528f28a-690b-4fab-9a50-8b64604234df req-c7374bbb-56b1-49ea-9da2-e6d1ec36a1d1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046728 Oct 31 19:29:52.163089 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 484/964] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 31 19:29:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:29:53.085183 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-1ce680d5-7c09-445b-b059-df501f5ae24c tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:29:53.087072 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-1ce680d5-7c09-445b-b059-df501f5ae24c tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] [instance: a3be5488-67cf-4a84-ae40-9c0bf189ffd1] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:29:53.093740 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-1ce680d5-7c09-445b-b059-df501f5ae24c tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:29:53.094537 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-1ce680d5-7c09-445b-b059-df501f5ae24c tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:29:53.094998 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-1ce680d5-7c09-445b-b059-df501f5ae24c tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:29:53.095984 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-1ce680d5-7c09-445b-b059-df501f5ae24c tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:29:53.096488 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-1ce680d5-7c09-445b-b059-df501f5ae24c tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:29:53.096944 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-1ce680d5-7c09-445b-b059-df501f5ae24c tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:29:53.113924 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.wsgi [None req-1ce680d5-7c09-445b-b059-df501f5ae24c tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] HTTP exception thrown: Instance a3be5488-67cf-4a84-ae40-9c0bf189ffd1 could not be found. Oct 31 19:29:53.115697 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-1ce680d5-7c09-445b-b059-df501f5ae24c tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Request method failure captured: Oct 31 19:29:53.115697 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: request: GET /compute/v2.1/servers/a3be5488-67cf-4a84-ae40-9c0bf189ffd1 HTTP/1.1 Oct 31 19:29:53.115697 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Accept: application/json Oct 31 19:29:53.115697 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Accept-Encoding: identity Oct 31 19:29:53.115697 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Connection: close Oct 31 19:29:53.115697 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Content-Length: 0 Oct 31 19:29:53.115697 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Content-Type: application/json Oct 31 19:29:53.115697 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Host: 10.222.0.16 Oct 31 19:29:53.115697 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Openstack-System-Scope: None Oct 31 19:29:53.115697 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: User-Agent: python-urllib3/1.26.12 Oct 31 19:29:53.115697 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Auth-Token: gAAAAABjYCG5aDHxCXWKl54hrIP8uylj79sP0BDeZd_ckOPD9KTXbM2ReEx2xP85m13HtVq0_y1CIML9YTOWHjoWbtPsbViKMinP0f-u0wr8bnwCjlILH4aKfybx_z4WSYI8NEE_nzlMlhmG0HnRtdfd3ZDvw9RFGweGeDxD4VM0dXtgMk2CUO4 Oct 31 19:29:53.115697 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Domain-Id: None Oct 31 19:29:53.115697 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Domain-Name: None Oct 31 19:29:53.115697 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Identity-Status: Confirmed Oct 31 19:29:53.115697 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Is-Admin-Project: True Oct 31 19:29:53.115697 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Project-Domain-Id: default Oct 31 19:29:53.115697 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Project-Domain-Name: Default Oct 31 19:29:53.115697 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Project-Id: adba9bc456234ea6ade63d41a1624967 Oct 31 19:29:53.115697 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Project-Name: tempest-AttachVolumeNegativeTest-1656947587 Oct 31 19:29:53.115697 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Role: member,reader Oct 31 19:29:53.115697 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Roles: member,reader Oct 31 19:29:53.117471 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/adba9bc456234ea6ade63d41a1624967"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_adba9bc456234ea6ade63d41a1624967", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/adba9bc456234ea6ade63d41a1624967"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/adba9bc456234ea6ade63d41a1624967"}]}] Oct 31 19:29:53.117471 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Tenant: tempest-AttachVolumeNegativeTest-1656947587 Oct 31 19:29:53.117471 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Tenant-Id: adba9bc456234ea6ade63d41a1624967 Oct 31 19:29:53.117471 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1656947587 Oct 31 19:29:53.117471 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User: tempest-AttachVolumeNegativeTest-1656947587-project Oct 31 19:29:53.117471 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User-Domain-Id: default Oct 31 19:29:53.117471 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User-Domain-Name: Default Oct 31 19:29:53.117471 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User-Id: 16778b0dd21d41eeaa6087b67931eef8 Oct 31 19:29:53.117471 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User-Name: tempest-AttachVolumeNegativeTest-1656947587-project Oct 31 19:29:53.117471 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: method: > Oct 31 19:29:53.117471 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: exception: Instance a3be5488-67cf-4a84-ae40-9c0bf189ffd1 could not be found. Oct 31 19:29:53.117471 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: action_args: {'id': 'a3be5488-67cf-4a84-ae40-9c0bf189ffd1'} Oct 31 19:29:53.118343 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 19:29:53.118343 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:29:53.118343 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 19:29:53.118343 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 19:29:53.118343 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 19:29:53.118343 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 19:29:53.118343 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 19:29:53.118343 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 19:29:53.118343 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 19:29:53.118343 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 19:29:53.118343 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3be5488-67cf-4a84-ae40-9c0bf189ffd1 could not be found. Oct 31 19:29:53.118343 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:29:53.118343 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 19:29:53.118343 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:29:53.118343 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:29:53.118343 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 19:29:53.118343 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 19:29:53.118343 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 19:29:53.118343 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 19:29:53.118343 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 19:29:53.119671 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 19:29:53.119671 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 19:29:53.119671 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 19:29:53.119671 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 19:29:53.119671 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 19:29:53.119671 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 19:29:53.119671 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 19:29:53.119671 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3be5488-67cf-4a84-ae40-9c0bf189ffd1 could not be found. Oct 31 19:29:53.119671 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:29:53.119671 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 19:29:53.119671 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:29:53.119671 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:29:53.119671 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 19:29:53.119671 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 19:29:53.119671 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 19:29:53.119671 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 19:29:53.119671 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3be5488-67cf-4a84-ae40-9c0bf189ffd1 could not be found. Oct 31 19:29:53.119671 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:29:53.120928 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-1ce680d5-7c09-445b-b059-df501f5ae24c tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Returning 404 to user: Instance a3be5488-67cf-4a84-ae40-9c0bf189ffd1 could not be found. {{(pid=118727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 19:29:53.120928 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-1ce680d5-7c09-445b-b059-df501f5ae24c tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] 10.222.0.16 "GET /compute/v2.1/servers/a3be5488-67cf-4a84-ae40-9c0bf189ffd1" status: 404 len: 111 microversion: 2.1 time: 0.038624 Oct 31 19:29:53.120928 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 481/965] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:29:53 2022] GET /compute/v2.1/servers/a3be5488-67cf-4a84-ae40-9c0bf189ffd1 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 19:29:53.130570 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-77f33e51-50db-4bf1-9a56-353b66b3cc2a tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Calling method '.version_select at 0x7f34f1f2bc10>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:29:53.152249 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-77f33e51-50db-4bf1-9a56-353b66b3cc2a tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1704044515" status: 202 len: 0 microversion: 2.1 time: 0.027334 Oct 31 19:29:53.153033 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 485/966] 10.222.0.16 () {58 vars in 1221 bytes} [Mon Oct 31 19:29:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1704044515 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 19:29:53.975426 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-2336a2ed-3fe0-4c2e-9acf-4674269a34cd tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:29:53.975916 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-2336a2ed-3fe0-4c2e-9acf-4674269a34cd tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] [instance: 1fd43154-badc-47b6-a5a7-d1f28e759bb0] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:29:53.982017 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-2336a2ed-3fe0-4c2e-9acf-4674269a34cd tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:29:53.982499 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-2336a2ed-3fe0-4c2e-9acf-4674269a34cd tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:29:53.982929 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-2336a2ed-3fe0-4c2e-9acf-4674269a34cd tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:29:53.983618 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-2336a2ed-3fe0-4c2e-9acf-4674269a34cd tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:29:53.984073 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-2336a2ed-3fe0-4c2e-9acf-4674269a34cd tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:29:53.984494 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-2336a2ed-3fe0-4c2e-9acf-4674269a34cd tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:29:54.070732 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.objects.instance [None req-2336a2ed-3fe0-4c2e-9acf-4674269a34cd tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lazy-loading 'services' on Instance uuid 1fd43154-badc-47b6-a5a7-d1f28e759bb0 {{(pid=118727) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 19:29:54.147675 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-2336a2ed-3fe0-4c2e-9acf-4674269a34cd tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] 10.222.0.16 "DELETE /compute/v2.1/servers/1fd43154-badc-47b6-a5a7-d1f28e759bb0/os-volume_attachments/dfda8425-9a81-4cdc-b619-1b0eb87b9e95" status: 202 len: 0 microversion: 2.1 time: 0.176277 Oct 31 19:29:54.148946 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 482/967] 10.222.0.16 () {58 vars in 1416 bytes} [Mon Oct 31 19:29:53 2022] DELETE /compute/v2.1/servers/1fd43154-badc-47b6-a5a7-d1f28e759bb0/os-volume_attachments/dfda8425-9a81-4cdc-b619-1b0eb87b9e95 => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 31 19:29:54.157621 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-286b0292-563a-4318-9037-40b24ac19dad tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:29:54.160129 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-286b0292-563a-4318-9037-40b24ac19dad tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] [instance: 1fd43154-badc-47b6-a5a7-d1f28e759bb0] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:29:54.177160 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-286b0292-563a-4318-9037-40b24ac19dad tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:29:54.177782 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-286b0292-563a-4318-9037-40b24ac19dad tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:29:54.178198 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-286b0292-563a-4318-9037-40b24ac19dad tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:29:54.179465 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-286b0292-563a-4318-9037-40b24ac19dad tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:29:54.180035 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-286b0292-563a-4318-9037-40b24ac19dad tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:29:54.180468 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-286b0292-563a-4318-9037-40b24ac19dad tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:29:54.217074 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-286b0292-563a-4318-9037-40b24ac19dad tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] 10.222.0.16 "GET /compute/v2.1/servers/1fd43154-badc-47b6-a5a7-d1f28e759bb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063453 Oct 31 19:29:54.217669 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 486/968] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Oct 31 19:29:54 2022] GET /compute/v2.1/servers/1fd43154-badc-47b6-a5a7-d1f28e759bb0/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:29:55.231337 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-5e8da10d-c517-44cf-ab65-b33770caf093 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:29:55.233653 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-5e8da10d-c517-44cf-ab65-b33770caf093 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] [instance: 1fd43154-badc-47b6-a5a7-d1f28e759bb0] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:29:55.239792 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-5e8da10d-c517-44cf-ab65-b33770caf093 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:29:55.240268 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-5e8da10d-c517-44cf-ab65-b33770caf093 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:29:55.240694 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-5e8da10d-c517-44cf-ab65-b33770caf093 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:29:55.241416 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-5e8da10d-c517-44cf-ab65-b33770caf093 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:29:55.241960 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-5e8da10d-c517-44cf-ab65-b33770caf093 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:29:55.242379 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-5e8da10d-c517-44cf-ab65-b33770caf093 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:29:55.425990 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-5e8da10d-c517-44cf-ab65-b33770caf093 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] 10.222.0.16 "GET /compute/v2.1/servers/1fd43154-badc-47b6-a5a7-d1f28e759bb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.199367 Oct 31 19:29:55.426533 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 483/969] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Oct 31 19:29:55 2022] GET /compute/v2.1/servers/1fd43154-badc-47b6-a5a7-d1f28e759bb0/os-volume_attachments => generated 197 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:29:56.438417 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-99ded9f3-93b5-4e48-9153-a015c4c9e5e4 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:29:56.440578 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-99ded9f3-93b5-4e48-9153-a015c4c9e5e4 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] [instance: 1fd43154-badc-47b6-a5a7-d1f28e759bb0] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:29:56.447008 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-99ded9f3-93b5-4e48-9153-a015c4c9e5e4 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:29:56.447482 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-99ded9f3-93b5-4e48-9153-a015c4c9e5e4 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:29:56.447907 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-99ded9f3-93b5-4e48-9153-a015c4c9e5e4 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:29:56.448584 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-99ded9f3-93b5-4e48-9153-a015c4c9e5e4 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:29:56.449034 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-99ded9f3-93b5-4e48-9153-a015c4c9e5e4 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:29:56.449450 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-99ded9f3-93b5-4e48-9153-a015c4c9e5e4 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:29:56.478557 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-99ded9f3-93b5-4e48-9153-a015c4c9e5e4 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] 10.222.0.16 "GET /compute/v2.1/servers/1fd43154-badc-47b6-a5a7-d1f28e759bb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044128 Oct 31 19:29:56.479103 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 487/970] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Oct 31 19:29:56 2022] GET /compute/v2.1/servers/1fd43154-badc-47b6-a5a7-d1f28e759bb0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:29:57.490862 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-99492299-f959-4372-9e62-0616f7768f7f tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:29:57.493081 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-99492299-f959-4372-9e62-0616f7768f7f tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] [instance: 1fd43154-badc-47b6-a5a7-d1f28e759bb0] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:29:57.499379 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-99492299-f959-4372-9e62-0616f7768f7f tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:29:57.499856 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-99492299-f959-4372-9e62-0616f7768f7f tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:29:57.500285 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-99492299-f959-4372-9e62-0616f7768f7f tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:29:57.500967 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-99492299-f959-4372-9e62-0616f7768f7f tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:29:57.501415 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-99492299-f959-4372-9e62-0616f7768f7f tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:29:57.501873 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-99492299-f959-4372-9e62-0616f7768f7f tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:29:57.531356 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-99492299-f959-4372-9e62-0616f7768f7f tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] 10.222.0.16 "GET /compute/v2.1/servers/1fd43154-badc-47b6-a5a7-d1f28e759bb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044455 Oct 31 19:29:57.531892 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 484/971] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Oct 31 19:29:57 2022] GET /compute/v2.1/servers/1fd43154-badc-47b6-a5a7-d1f28e759bb0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:29:58.544018 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-776efdb3-f007-4d28-a722-ac1ea39f7a19 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:29:58.546240 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-776efdb3-f007-4d28-a722-ac1ea39f7a19 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] [instance: 1fd43154-badc-47b6-a5a7-d1f28e759bb0] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:29:58.553124 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-776efdb3-f007-4d28-a722-ac1ea39f7a19 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:29:58.553622 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-776efdb3-f007-4d28-a722-ac1ea39f7a19 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:29:58.554055 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-776efdb3-f007-4d28-a722-ac1ea39f7a19 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:29:58.554733 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-776efdb3-f007-4d28-a722-ac1ea39f7a19 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:29:58.555180 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-776efdb3-f007-4d28-a722-ac1ea39f7a19 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:29:58.555598 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-776efdb3-f007-4d28-a722-ac1ea39f7a19 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:29:58.583765 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-776efdb3-f007-4d28-a722-ac1ea39f7a19 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] 10.222.0.16 "GET /compute/v2.1/servers/1fd43154-badc-47b6-a5a7-d1f28e759bb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043724 Oct 31 19:29:58.584337 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 488/972] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Oct 31 19:29:58 2022] GET /compute/v2.1/servers/1fd43154-badc-47b6-a5a7-d1f28e759bb0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:29:59.596050 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-26fd3e83-e0dd-47b8-815f-95215a7790d4 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:29:59.598213 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-26fd3e83-e0dd-47b8-815f-95215a7790d4 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] [instance: 1fd43154-badc-47b6-a5a7-d1f28e759bb0] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:29:59.605237 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-26fd3e83-e0dd-47b8-815f-95215a7790d4 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:29:59.605753 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-26fd3e83-e0dd-47b8-815f-95215a7790d4 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:29:59.606185 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-26fd3e83-e0dd-47b8-815f-95215a7790d4 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:29:59.606868 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-26fd3e83-e0dd-47b8-815f-95215a7790d4 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:29:59.607320 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-26fd3e83-e0dd-47b8-815f-95215a7790d4 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:29:59.607741 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-26fd3e83-e0dd-47b8-815f-95215a7790d4 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:29:59.635920 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-26fd3e83-e0dd-47b8-815f-95215a7790d4 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] 10.222.0.16 "GET /compute/v2.1/servers/1fd43154-badc-47b6-a5a7-d1f28e759bb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043875 Oct 31 19:29:59.636460 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 485/973] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Oct 31 19:29:59 2022] GET /compute/v2.1/servers/1fd43154-badc-47b6-a5a7-d1f28e759bb0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:30:00.648899 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-101fa41d-a5d3-46dc-bd74-653a796bdf03 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:30:00.651319 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-101fa41d-a5d3-46dc-bd74-653a796bdf03 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] [instance: 1fd43154-badc-47b6-a5a7-d1f28e759bb0] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:30:00.657913 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-101fa41d-a5d3-46dc-bd74-653a796bdf03 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:30:00.658407 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-101fa41d-a5d3-46dc-bd74-653a796bdf03 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:30:00.658851 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-101fa41d-a5d3-46dc-bd74-653a796bdf03 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:30:00.659552 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-101fa41d-a5d3-46dc-bd74-653a796bdf03 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:30:00.660011 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-101fa41d-a5d3-46dc-bd74-653a796bdf03 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:30:00.660458 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-101fa41d-a5d3-46dc-bd74-653a796bdf03 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:30:00.690831 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-101fa41d-a5d3-46dc-bd74-653a796bdf03 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] 10.222.0.16 "GET /compute/v2.1/servers/1fd43154-badc-47b6-a5a7-d1f28e759bb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046426 Oct 31 19:30:00.691584 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 489/974] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Oct 31 19:30:00 2022] GET /compute/v2.1/servers/1fd43154-badc-47b6-a5a7-d1f28e759bb0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:30:01.704263 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-da4d3b56-0919-4322-b1b9-8a843cdfd6ed tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:30:01.706421 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-da4d3b56-0919-4322-b1b9-8a843cdfd6ed tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] [instance: 1fd43154-badc-47b6-a5a7-d1f28e759bb0] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:30:01.712729 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-da4d3b56-0919-4322-b1b9-8a843cdfd6ed tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:30:01.713209 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-da4d3b56-0919-4322-b1b9-8a843cdfd6ed tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:30:01.713673 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-da4d3b56-0919-4322-b1b9-8a843cdfd6ed tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:30:01.714361 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-da4d3b56-0919-4322-b1b9-8a843cdfd6ed tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:30:01.714814 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-da4d3b56-0919-4322-b1b9-8a843cdfd6ed tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:30:01.715240 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-da4d3b56-0919-4322-b1b9-8a843cdfd6ed tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:30:01.744584 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-da4d3b56-0919-4322-b1b9-8a843cdfd6ed tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] 10.222.0.16 "GET /compute/v2.1/servers/1fd43154-badc-47b6-a5a7-d1f28e759bb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044325 Oct 31 19:30:01.745123 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 486/975] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Oct 31 19:30:01 2022] GET /compute/v2.1/servers/1fd43154-badc-47b6-a5a7-d1f28e759bb0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:30:02.756402 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-cfa83103-7180-42d6-8065-294ca8a79fc7 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:30:02.758567 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-cfa83103-7180-42d6-8065-294ca8a79fc7 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] [instance: 1fd43154-badc-47b6-a5a7-d1f28e759bb0] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:30:02.764823 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-cfa83103-7180-42d6-8065-294ca8a79fc7 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:30:02.765294 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-cfa83103-7180-42d6-8065-294ca8a79fc7 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:30:02.765756 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-cfa83103-7180-42d6-8065-294ca8a79fc7 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:30:02.766436 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-cfa83103-7180-42d6-8065-294ca8a79fc7 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:30:02.766885 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-cfa83103-7180-42d6-8065-294ca8a79fc7 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:30:02.767302 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-cfa83103-7180-42d6-8065-294ca8a79fc7 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:30:02.798595 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-cfa83103-7180-42d6-8065-294ca8a79fc7 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] 10.222.0.16 "GET /compute/v2.1/servers/1fd43154-badc-47b6-a5a7-d1f28e759bb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045688 Oct 31 19:30:02.798763 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 490/976] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Oct 31 19:30:02 2022] GET /compute/v2.1/servers/1fd43154-badc-47b6-a5a7-d1f28e759bb0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:30:03.810557 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-5c66373c-9d91-43d2-8961-e49a650a1a6c tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:30:03.812681 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-5c66373c-9d91-43d2-8961-e49a650a1a6c tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] [instance: 1fd43154-badc-47b6-a5a7-d1f28e759bb0] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:30:03.819490 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-5c66373c-9d91-43d2-8961-e49a650a1a6c tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:30:03.819968 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-5c66373c-9d91-43d2-8961-e49a650a1a6c tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:30:03.820396 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-5c66373c-9d91-43d2-8961-e49a650a1a6c tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:30:03.821071 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-5c66373c-9d91-43d2-8961-e49a650a1a6c tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:30:03.821522 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-5c66373c-9d91-43d2-8961-e49a650a1a6c tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:30:03.821963 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-5c66373c-9d91-43d2-8961-e49a650a1a6c tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:30:03.850664 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-5c66373c-9d91-43d2-8961-e49a650a1a6c tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] 10.222.0.16 "GET /compute/v2.1/servers/1fd43154-badc-47b6-a5a7-d1f28e759bb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044086 Oct 31 19:30:03.851196 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 487/977] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Oct 31 19:30:03 2022] GET /compute/v2.1/servers/1fd43154-badc-47b6-a5a7-d1f28e759bb0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:30:04.863313 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-23c62b1c-bb8c-4575-a15b-38383816259d tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:30:04.866327 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-23c62b1c-bb8c-4575-a15b-38383816259d tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] [instance: 1fd43154-badc-47b6-a5a7-d1f28e759bb0] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:30:04.873464 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-23c62b1c-bb8c-4575-a15b-38383816259d tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:30:04.874258 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-23c62b1c-bb8c-4575-a15b-38383816259d tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:30:04.874803 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-23c62b1c-bb8c-4575-a15b-38383816259d tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:30:04.876083 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-23c62b1c-bb8c-4575-a15b-38383816259d tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:30:04.876554 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-23c62b1c-bb8c-4575-a15b-38383816259d tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:30:04.876987 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-23c62b1c-bb8c-4575-a15b-38383816259d tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:30:04.910259 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-23c62b1c-bb8c-4575-a15b-38383816259d tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] 10.222.0.16 "GET /compute/v2.1/servers/1fd43154-badc-47b6-a5a7-d1f28e759bb0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051408 Oct 31 19:30:04.910827 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 491/978] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Oct 31 19:30:04 2022] GET /compute/v2.1/servers/1fd43154-badc-47b6-a5a7-d1f28e759bb0/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 31 19:30:04.974071 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-ec703961-dbe2-41c4-ab24-66b6ddd2644b tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:30:04.974573 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-ec703961-dbe2-41c4-ab24-66b6ddd2644b tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] [instance: 1fd43154-badc-47b6-a5a7-d1f28e759bb0] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:30:04.980864 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-ec703961-dbe2-41c4-ab24-66b6ddd2644b tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:30:04.981373 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-ec703961-dbe2-41c4-ab24-66b6ddd2644b tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:30:04.981871 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-ec703961-dbe2-41c4-ab24-66b6ddd2644b tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:30:04.982560 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-ec703961-dbe2-41c4-ab24-66b6ddd2644b tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:30:04.983014 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-ec703961-dbe2-41c4-ab24-66b6ddd2644b tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:30:04.983441 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-ec703961-dbe2-41c4-ab24-66b6ddd2644b tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:30:05.008297 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-ec703961-dbe2-41c4-ab24-66b6ddd2644b tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] [instance: 1fd43154-badc-47b6-a5a7-d1f28e759bb0] Going to try to terminate instance {{(pid=118727) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 19:30:05.085330 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-ec703961-dbe2-41c4-ab24-66b6ddd2644b tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] 10.222.0.16 "DELETE /compute/v2.1/servers/1fd43154-badc-47b6-a5a7-d1f28e759bb0" status: 204 len: 0 microversion: 2.1 time: 0.114755 Oct 31 19:30:05.085982 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 488/979] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 31 19:30:04 2022] DELETE /compute/v2.1/servers/1fd43154-badc-47b6-a5a7-d1f28e759bb0 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 19:30:05.094330 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-ce0ec165-76b4-4e81-aa63-470efd6a8c9a tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:30:05.094945 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-ce0ec165-76b4-4e81-aa63-470efd6a8c9a tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] [instance: 1fd43154-badc-47b6-a5a7-d1f28e759bb0] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:30:05.100793 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-ce0ec165-76b4-4e81-aa63-470efd6a8c9a tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:30:05.101282 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-ce0ec165-76b4-4e81-aa63-470efd6a8c9a tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:30:05.101753 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-ce0ec165-76b4-4e81-aa63-470efd6a8c9a tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:30:05.102455 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-ce0ec165-76b4-4e81-aa63-470efd6a8c9a tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:30:05.102917 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-ce0ec165-76b4-4e81-aa63-470efd6a8c9a tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:30:05.103380 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-ce0ec165-76b4-4e81-aa63-470efd6a8c9a tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:30:05.231529 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-ce0ec165-76b4-4e81-aa63-470efd6a8c9a tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16778b0dd21d41eeaa6087b67931eef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba9bc456234ea6ade63d41a1624967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:30:05.239211 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-ce0ec165-76b4-4e81-aa63-470efd6a8c9a tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] 10.222.0.16 "GET /compute/v2.1/servers/1fd43154-badc-47b6-a5a7-d1f28e759bb0" status: 200 len: 1681 microversion: 2.1 time: 0.148651 Oct 31 19:30:05.239777 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 492/980] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:30:05 2022] GET /compute/v2.1/servers/1fd43154-badc-47b6-a5a7-d1f28e759bb0 => generated 1681 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:30:06.263026 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-d8f812e8-df70-49b6-8e13-e463a3eecdb5 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:30:06.263723 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-d8f812e8-df70-49b6-8e13-e463a3eecdb5 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] [instance: 1fd43154-badc-47b6-a5a7-d1f28e759bb0] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:30:06.270054 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-d8f812e8-df70-49b6-8e13-e463a3eecdb5 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:30:06.270536 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-d8f812e8-df70-49b6-8e13-e463a3eecdb5 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:30:06.271614 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-d8f812e8-df70-49b6-8e13-e463a3eecdb5 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:30:06.272304 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-d8f812e8-df70-49b6-8e13-e463a3eecdb5 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:30:06.272758 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-d8f812e8-df70-49b6-8e13-e463a3eecdb5 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:30:06.273183 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-d8f812e8-df70-49b6-8e13-e463a3eecdb5 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:30:06.403205 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-d8f812e8-df70-49b6-8e13-e463a3eecdb5 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16778b0dd21d41eeaa6087b67931eef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba9bc456234ea6ade63d41a1624967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:30:06.411063 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-d8f812e8-df70-49b6-8e13-e463a3eecdb5 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] 10.222.0.16 "GET /compute/v2.1/servers/1fd43154-badc-47b6-a5a7-d1f28e759bb0" status: 200 len: 1681 microversion: 2.1 time: 0.152240 Oct 31 19:30:06.412235 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 489/981] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:30:06 2022] GET /compute/v2.1/servers/1fd43154-badc-47b6-a5a7-d1f28e759bb0 => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:30:07.435709 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-e12dbea2-6068-4784-af0c-3cdae170e7c3 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:30:07.436864 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-e12dbea2-6068-4784-af0c-3cdae170e7c3 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] [instance: 1fd43154-badc-47b6-a5a7-d1f28e759bb0] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:30:07.443928 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-e12dbea2-6068-4784-af0c-3cdae170e7c3 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:30:07.444426 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-e12dbea2-6068-4784-af0c-3cdae170e7c3 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:30:07.444859 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-e12dbea2-6068-4784-af0c-3cdae170e7c3 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:30:07.445985 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-e12dbea2-6068-4784-af0c-3cdae170e7c3 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:30:07.446560 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-e12dbea2-6068-4784-af0c-3cdae170e7c3 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:30:07.446871 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-e12dbea2-6068-4784-af0c-3cdae170e7c3 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:30:07.490516 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [req-c39b0959-a17b-43e4-b921-02fdcc5b79a1 req-13d728f9-1f2c-4de4-9060-38d265d3d8e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fd43154-badc-47b6-a5a7-d1f28e759bb0", "name": "network-vif-deleted", "tag": "03f69bfc-980f-40fa-86a8-15bddfdfdfd1"}]} {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:30:07.501805 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [req-c39b0959-a17b-43e4-b921-02fdcc5b79a1 req-13d728f9-1f2c-4de4-9060-38d265d3d8e9 service nova] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:30:07.502686 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [req-c39b0959-a17b-43e4-b921-02fdcc5b79a1 req-13d728f9-1f2c-4de4-9060-38d265d3d8e9 service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:30:07.503340 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [req-c39b0959-a17b-43e4-b921-02fdcc5b79a1 req-13d728f9-1f2c-4de4-9060-38d265d3d8e9 service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:30:07.517465 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.compute.server_external_events [req-c39b0959-a17b-43e4-b921-02fdcc5b79a1 req-13d728f9-1f2c-4de4-9060-38d265d3d8e9 service nova] Creating event network-vif-deleted:03f69bfc-980f-40fa-86a8-15bddfdfdfd1 for instance 1fd43154-badc-47b6-a5a7-d1f28e759bb0 on hv-cinder-86309 Oct 31 19:30:07.517718 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-e12dbea2-6068-4784-af0c-3cdae170e7c3 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16778b0dd21d41eeaa6087b67931eef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba9bc456234ea6ade63d41a1624967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:30:07.522524 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [req-c39b0959-a17b-43e4-b921-02fdcc5b79a1 req-13d728f9-1f2c-4de4-9060-38d265d3d8e9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040955 Oct 31 19:30:07.523331 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 490/982] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 31 19:30:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:30:07.528336 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-e12dbea2-6068-4784-af0c-3cdae170e7c3 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] 10.222.0.16 "GET /compute/v2.1/servers/1fd43154-badc-47b6-a5a7-d1f28e759bb0" status: 200 len: 1614 microversion: 2.1 time: 0.096810 Oct 31 19:30:07.529058 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 493/983] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:30:07 2022] GET /compute/v2.1/servers/1fd43154-badc-47b6-a5a7-d1f28e759bb0 => generated 1614 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:30:08.555881 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-72e1c6f3-6766-43c4-ac75-8a3f0d9256b2 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:30:08.556586 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-72e1c6f3-6766-43c4-ac75-8a3f0d9256b2 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] [instance: 1fd43154-badc-47b6-a5a7-d1f28e759bb0] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:30:08.562915 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-72e1c6f3-6766-43c4-ac75-8a3f0d9256b2 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:30:08.563400 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-72e1c6f3-6766-43c4-ac75-8a3f0d9256b2 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:30:08.563841 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-72e1c6f3-6766-43c4-ac75-8a3f0d9256b2 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:30:08.564534 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-72e1c6f3-6766-43c4-ac75-8a3f0d9256b2 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:30:08.565000 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-72e1c6f3-6766-43c4-ac75-8a3f0d9256b2 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:30:08.565427 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-72e1c6f3-6766-43c4-ac75-8a3f0d9256b2 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:30:08.579002 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.wsgi [None req-72e1c6f3-6766-43c4-ac75-8a3f0d9256b2 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] HTTP exception thrown: Instance 1fd43154-badc-47b6-a5a7-d1f28e759bb0 could not be found. Oct 31 19:30:08.580625 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-72e1c6f3-6766-43c4-ac75-8a3f0d9256b2 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Request method failure captured: Oct 31 19:30:08.580625 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: request: GET /compute/v2.1/servers/1fd43154-badc-47b6-a5a7-d1f28e759bb0 HTTP/1.1 Oct 31 19:30:08.580625 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Accept: application/json Oct 31 19:30:08.580625 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Accept-Encoding: identity Oct 31 19:30:08.580625 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Connection: close Oct 31 19:30:08.580625 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Content-Length: 0 Oct 31 19:30:08.580625 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Content-Type: application/json Oct 31 19:30:08.580625 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Host: 10.222.0.16 Oct 31 19:30:08.580625 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Openstack-System-Scope: None Oct 31 19:30:08.580625 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: User-Agent: python-urllib3/1.26.12 Oct 31 19:30:08.580625 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Auth-Token: gAAAAABjYCG5aDHxCXWKl54hrIP8uylj79sP0BDeZd_ckOPD9KTXbM2ReEx2xP85m13HtVq0_y1CIML9YTOWHjoWbtPsbViKMinP0f-u0wr8bnwCjlILH4aKfybx_z4WSYI8NEE_nzlMlhmG0HnRtdfd3ZDvw9RFGweGeDxD4VM0dXtgMk2CUO4 Oct 31 19:30:08.580625 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Domain-Id: None Oct 31 19:30:08.580625 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Domain-Name: None Oct 31 19:30:08.580625 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Identity-Status: Confirmed Oct 31 19:30:08.580625 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Is-Admin-Project: True Oct 31 19:30:08.580625 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Project-Domain-Id: default Oct 31 19:30:08.580625 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Project-Domain-Name: Default Oct 31 19:30:08.580625 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Project-Id: adba9bc456234ea6ade63d41a1624967 Oct 31 19:30:08.580625 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Project-Name: tempest-AttachVolumeNegativeTest-1656947587 Oct 31 19:30:08.580625 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Role: member,reader Oct 31 19:30:08.580625 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Roles: member,reader Oct 31 19:30:08.582341 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/adba9bc456234ea6ade63d41a1624967"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_adba9bc456234ea6ade63d41a1624967", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/adba9bc456234ea6ade63d41a1624967"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/adba9bc456234ea6ade63d41a1624967"}]}] Oct 31 19:30:08.582341 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Tenant: tempest-AttachVolumeNegativeTest-1656947587 Oct 31 19:30:08.582341 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Tenant-Id: adba9bc456234ea6ade63d41a1624967 Oct 31 19:30:08.582341 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1656947587 Oct 31 19:30:08.582341 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User: tempest-AttachVolumeNegativeTest-1656947587-project Oct 31 19:30:08.582341 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User-Domain-Id: default Oct 31 19:30:08.582341 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User-Domain-Name: Default Oct 31 19:30:08.582341 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User-Id: 16778b0dd21d41eeaa6087b67931eef8 Oct 31 19:30:08.582341 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User-Name: tempest-AttachVolumeNegativeTest-1656947587-project Oct 31 19:30:08.582341 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: method: > Oct 31 19:30:08.582341 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: exception: Instance 1fd43154-badc-47b6-a5a7-d1f28e759bb0 could not be found. Oct 31 19:30:08.582341 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: action_args: {'id': '1fd43154-badc-47b6-a5a7-d1f28e759bb0'} Oct 31 19:30:08.583820 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 19:30:08.583820 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:30:08.583820 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 19:30:08.583820 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 19:30:08.583820 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 19:30:08.583820 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 19:30:08.583820 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 19:30:08.583820 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 19:30:08.583820 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 19:30:08.583820 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 19:30:08.583820 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1fd43154-badc-47b6-a5a7-d1f28e759bb0 could not be found. Oct 31 19:30:08.583820 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:30:08.583820 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 19:30:08.583820 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:30:08.583820 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:30:08.583820 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 19:30:08.583820 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 19:30:08.583820 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 19:30:08.583820 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 19:30:08.583820 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 19:30:08.585447 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 19:30:08.585447 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 19:30:08.585447 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 19:30:08.585447 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 19:30:08.585447 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 19:30:08.585447 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 19:30:08.585447 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 19:30:08.585447 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1fd43154-badc-47b6-a5a7-d1f28e759bb0 could not be found. Oct 31 19:30:08.585447 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:30:08.585447 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 19:30:08.585447 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:30:08.585447 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:30:08.585447 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 19:30:08.585447 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 19:30:08.585447 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 19:30:08.585447 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 19:30:08.585447 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1fd43154-badc-47b6-a5a7-d1f28e759bb0 could not be found. Oct 31 19:30:08.585447 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:30:08.587096 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-72e1c6f3-6766-43c4-ac75-8a3f0d9256b2 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Returning 404 to user: Instance 1fd43154-badc-47b6-a5a7-d1f28e759bb0 could not be found. {{(pid=118727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 19:30:08.587096 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-72e1c6f3-6766-43c4-ac75-8a3f0d9256b2 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] 10.222.0.16 "GET /compute/v2.1/servers/1fd43154-badc-47b6-a5a7-d1f28e759bb0" status: 404 len: 111 microversion: 2.1 time: 0.030793 Oct 31 19:30:08.587096 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 491/984] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:30:08 2022] GET /compute/v2.1/servers/1fd43154-badc-47b6-a5a7-d1f28e759bb0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 19:30:08.591377 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-799c8486-df6b-4879-abd4-8a0ccb6a11f0 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Calling method '.version_select at 0x7f34f205caf0>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:30:08.610335 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-799c8486-df6b-4879-abd4-8a0ccb6a11f0 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1910957442" status: 202 len: 0 microversion: 2.1 time: 0.022730 Oct 31 19:30:08.610906 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 494/985] 10.222.0.16 () {58 vars in 1221 bytes} [Mon Oct 31 19:30:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1910957442 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 19:30:09.228763 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-4c94b286-103b-47fd-b8b1-985741c7c561 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Action: 'create', calling method: .version_select at 0x7f34f58c99d0>, body: {"keypair": {"name": "tempest-keypair-1893997936", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFOsx/Pjzk9NgQRQKLy+Nd8ImKmmmugUMz/Bp8Isg9AuQE9KxiimRG/5FGLUm4gMyMRJzI1Ju1v+T4qHMmuQh0F8ERMcdAjRZtCCfYQwkCzK1Z853R5aTu1Vjog4SSmwgw=="}} {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:30:09.244825 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.quota [None req-4c94b286-103b-47fd-b8b1-985741c7c561 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Getting quotas for project adba9bc456234ea6ade63d41a1624967. Resources: {'key_pairs'} {{(pid=118727) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 19:30:09.248561 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.quota [None req-4c94b286-103b-47fd-b8b1-985741c7c561 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Getting quotas for user 16778b0dd21d41eeaa6087b67931eef8 and project adba9bc456234ea6ade63d41a1624967. Resources: {'key_pairs'} {{(pid=118727) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 19:30:09.269161 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-4c94b286-103b-47fd-b8b1-985741c7c561 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.044395 Oct 31 19:30:09.269761 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 492/986] 10.222.0.16 () {60 vars in 1159 bytes} [Mon Oct 31 19:30:09 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:30:10.500433 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-ffec3c58-8adb-49c1-be44-725b8cf411af tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-332100750", "imageRef": "a9795ee0-6722-4e1e-8fc8-a6c2e68f3049", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fa342027-4076-4973-b2c6-612147f6fd68"}], "security_groups": [{"name": "tempest-securitygroup--1182883352"}], "key_name": "tempest-keypair-1893997936", "user_data": "}} {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:30:10.601584 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.network.neutron [None req-ffec3c58-8adb-49c1-be44-725b8cf411af tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] validate_networks() for [('fa342027-4076-4973-b2c6-612147f6fd68', None, None, None, None, None)] {{(pid=118726) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 19:30:10.972003 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.virt.hardware [None req-ffec3c58-8adb-49c1-be44-725b8cf411af tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Flavor limits 0:0:0 {{(pid=118726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 19:30:10.972419 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.virt.hardware [None req-ffec3c58-8adb-49c1-be44-725b8cf411af tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Image limits 0:0:0 {{(pid=118726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 19:30:10.972889 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.virt.hardware [None req-ffec3c58-8adb-49c1-be44-725b8cf411af tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Flavor pref 0:0:0 {{(pid=118726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 19:30:10.973294 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.virt.hardware [None req-ffec3c58-8adb-49c1-be44-725b8cf411af tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Image pref 0:0:0 {{(pid=118726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 19:30:10.974312 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.virt.hardware [None req-ffec3c58-8adb-49c1-be44-725b8cf411af tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 19:30:10.982848 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-ffec3c58-8adb-49c1-be44-725b8cf411af tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:30:10.983328 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-ffec3c58-8adb-49c1-be44-725b8cf411af tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:30:10.983755 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-ffec3c58-8adb-49c1-be44-725b8cf411af tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:30:10.984468 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-ffec3c58-8adb-49c1-be44-725b8cf411af tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:30:10.984916 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-ffec3c58-8adb-49c1-be44-725b8cf411af tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:30:10.985334 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-ffec3c58-8adb-49c1-be44-725b8cf411af tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:30:11.001827 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.quota [None req-ffec3c58-8adb-49c1-be44-725b8cf411af tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Getting quotas for project adba9bc456234ea6ade63d41a1624967. Resources: {'instances', 'ram', 'cores'} {{(pid=118726) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 19:30:11.005710 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.quota [None req-ffec3c58-8adb-49c1-be44-725b8cf411af tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Getting quotas for user 16778b0dd21d41eeaa6087b67931eef8 and project adba9bc456234ea6ade63d41a1624967. Resources: {'instances', 'ram', 'cores'} {{(pid=118726) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 19:30:11.016283 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-ffec3c58-8adb-49c1-be44-725b8cf411af tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Going to run 1 instances... {{(pid=118726) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 19:30:11.018537 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-ffec3c58-8adb-49c1-be44-725b8cf411af tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] [instance: 0fc7bec3-39c9-4048-a84e-914159181e7d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9795ee0-6722-4e1e-8fc8-a6c2e68f3049',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118726) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 19:30:11.065996 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-ffec3c58-8adb-49c1-be44-725b8cf411af tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.570411 Oct 31 19:30:11.066634 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 495/987] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 31 19:30:10 2022] POST /compute/v2.1/servers => generated 402 bytes in 572 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 19:30:11.078106 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-4b69917e-9409-4e2d-83d7-3f71d2f271e6 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:30:11.078709 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-4b69917e-9409-4e2d-83d7-3f71d2f271e6 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] [instance: 0fc7bec3-39c9-4048-a84e-914159181e7d] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:30:11.134106 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-4b69917e-9409-4e2d-83d7-3f71d2f271e6 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16778b0dd21d41eeaa6087b67931eef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba9bc456234ea6ade63d41a1624967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:30:11.140891 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-4b69917e-9409-4e2d-83d7-3f71d2f271e6 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] 10.222.0.16 "GET /compute/v2.1/servers/0fc7bec3-39c9-4048-a84e-914159181e7d" status: 200 len: 1241 microversion: 2.1 time: 0.067215 Oct 31 19:30:11.141456 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 493/988] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:30:11 2022] GET /compute/v2.1/servers/0fc7bec3-39c9-4048-a84e-914159181e7d => generated 1241 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:30:12.165227 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-31a8335f-ad44-4326-97ea-a8997e9b5513 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:30:12.165900 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-31a8335f-ad44-4326-97ea-a8997e9b5513 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] [instance: 0fc7bec3-39c9-4048-a84e-914159181e7d] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:30:12.172079 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-31a8335f-ad44-4326-97ea-a8997e9b5513 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:30:12.172568 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-31a8335f-ad44-4326-97ea-a8997e9b5513 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:30:12.173008 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-31a8335f-ad44-4326-97ea-a8997e9b5513 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:30:12.173738 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-31a8335f-ad44-4326-97ea-a8997e9b5513 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:30:12.174420 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-31a8335f-ad44-4326-97ea-a8997e9b5513 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:30:12.174848 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-31a8335f-ad44-4326-97ea-a8997e9b5513 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:30:12.239346 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-31a8335f-ad44-4326-97ea-a8997e9b5513 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16778b0dd21d41eeaa6087b67931eef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba9bc456234ea6ade63d41a1624967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:30:12.246931 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-31a8335f-ad44-4326-97ea-a8997e9b5513 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] 10.222.0.16 "GET /compute/v2.1/servers/0fc7bec3-39c9-4048-a84e-914159181e7d" status: 200 len: 1299 microversion: 2.1 time: 0.086782 Oct 31 19:30:12.247505 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 496/989] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:30:12 2022] GET /compute/v2.1/servers/0fc7bec3-39c9-4048-a84e-914159181e7d => generated 1299 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:30:13.269290 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-5b79fe6d-1a0a-43d0-9204-96e8525e85d2 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:30:13.271017 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-5b79fe6d-1a0a-43d0-9204-96e8525e85d2 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] [instance: 0fc7bec3-39c9-4048-a84e-914159181e7d] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:30:13.277320 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-5b79fe6d-1a0a-43d0-9204-96e8525e85d2 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:30:13.277839 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-5b79fe6d-1a0a-43d0-9204-96e8525e85d2 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:30:13.278279 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-5b79fe6d-1a0a-43d0-9204-96e8525e85d2 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:30:13.278971 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-5b79fe6d-1a0a-43d0-9204-96e8525e85d2 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:30:13.279426 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-5b79fe6d-1a0a-43d0-9204-96e8525e85d2 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:30:13.279952 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-5b79fe6d-1a0a-43d0-9204-96e8525e85d2 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:30:13.476844 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-5b79fe6d-1a0a-43d0-9204-96e8525e85d2 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16778b0dd21d41eeaa6087b67931eef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba9bc456234ea6ade63d41a1624967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:30:13.484489 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-5b79fe6d-1a0a-43d0-9204-96e8525e85d2 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] 10.222.0.16 "GET /compute/v2.1/servers/0fc7bec3-39c9-4048-a84e-914159181e7d" status: 200 len: 1367 microversion: 2.1 time: 0.219106 Oct 31 19:30:13.484987 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 494/990] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:30:13 2022] GET /compute/v2.1/servers/0fc7bec3-39c9-4048-a84e-914159181e7d => generated 1367 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:30:13.532814 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [req-8d0ba28f-391a-46ee-b29e-06fe8898e896 req-a68a4de2-d24f-41c1-a8ef-c2aa87fa3503 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0fc7bec3-39c9-4048-a84e-914159181e7d", "tag": "a5625ca5-7f65-4381-bf93-f9cea628dbd1"}]} {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:30:13.544965 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [req-8d0ba28f-391a-46ee-b29e-06fe8898e896 req-a68a4de2-d24f-41c1-a8ef-c2aa87fa3503 service nova] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:30:13.545448 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [req-8d0ba28f-391a-46ee-b29e-06fe8898e896 req-a68a4de2-d24f-41c1-a8ef-c2aa87fa3503 service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:30:13.546013 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [req-8d0ba28f-391a-46ee-b29e-06fe8898e896 req-a68a4de2-d24f-41c1-a8ef-c2aa87fa3503 service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:30:13.557780 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.compute.server_external_events [req-8d0ba28f-391a-46ee-b29e-06fe8898e896 req-a68a4de2-d24f-41c1-a8ef-c2aa87fa3503 service nova] Creating event network-changed:a5625ca5-7f65-4381-bf93-f9cea628dbd1 for instance 0fc7bec3-39c9-4048-a84e-914159181e7d on hv-cinder-86309 Oct 31 19:30:13.562944 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [req-8d0ba28f-391a-46ee-b29e-06fe8898e896 req-a68a4de2-d24f-41c1-a8ef-c2aa87fa3503 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034755 Oct 31 19:30:13.563551 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 497/991] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 31 19:30:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:30:14.507325 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-76a342d9-b797-4b7f-97f6-b69bfa81eae8 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:30:14.507989 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-76a342d9-b797-4b7f-97f6-b69bfa81eae8 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] [instance: 0fc7bec3-39c9-4048-a84e-914159181e7d] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:30:14.514627 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-76a342d9-b797-4b7f-97f6-b69bfa81eae8 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:30:14.515122 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-76a342d9-b797-4b7f-97f6-b69bfa81eae8 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:30:14.515561 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-76a342d9-b797-4b7f-97f6-b69bfa81eae8 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:30:14.516258 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-76a342d9-b797-4b7f-97f6-b69bfa81eae8 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:30:14.516711 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-76a342d9-b797-4b7f-97f6-b69bfa81eae8 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:30:14.517164 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-76a342d9-b797-4b7f-97f6-b69bfa81eae8 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:30:14.643744 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-76a342d9-b797-4b7f-97f6-b69bfa81eae8 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16778b0dd21d41eeaa6087b67931eef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba9bc456234ea6ade63d41a1624967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:30:14.651286 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-76a342d9-b797-4b7f-97f6-b69bfa81eae8 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] 10.222.0.16 "GET /compute/v2.1/servers/0fc7bec3-39c9-4048-a84e-914159181e7d" status: 200 len: 1367 microversion: 2.1 time: 0.148382 Oct 31 19:30:14.651847 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 495/992] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:30:14 2022] GET /compute/v2.1/servers/0fc7bec3-39c9-4048-a84e-914159181e7d => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:30:15.674715 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-ef8915c9-6436-441d-b2bf-2bd2a65ea788 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:30:15.675404 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-ef8915c9-6436-441d-b2bf-2bd2a65ea788 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] [instance: 0fc7bec3-39c9-4048-a84e-914159181e7d] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:30:15.681960 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-ef8915c9-6436-441d-b2bf-2bd2a65ea788 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:30:15.682433 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-ef8915c9-6436-441d-b2bf-2bd2a65ea788 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:30:15.682857 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-ef8915c9-6436-441d-b2bf-2bd2a65ea788 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:30:15.683534 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-ef8915c9-6436-441d-b2bf-2bd2a65ea788 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:30:15.683986 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-ef8915c9-6436-441d-b2bf-2bd2a65ea788 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:30:15.684408 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-ef8915c9-6436-441d-b2bf-2bd2a65ea788 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:30:15.813900 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-ef8915c9-6436-441d-b2bf-2bd2a65ea788 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16778b0dd21d41eeaa6087b67931eef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba9bc456234ea6ade63d41a1624967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:30:15.821959 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-ef8915c9-6436-441d-b2bf-2bd2a65ea788 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] 10.222.0.16 "GET /compute/v2.1/servers/0fc7bec3-39c9-4048-a84e-914159181e7d" status: 200 len: 1367 microversion: 2.1 time: 0.151471 Oct 31 19:30:15.822536 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 498/993] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:30:15 2022] GET /compute/v2.1/servers/0fc7bec3-39c9-4048-a84e-914159181e7d => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:30:16.844347 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-c7d45cc6-cd05-4f29-9589-5543e92d2f72 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:30:16.844901 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-c7d45cc6-cd05-4f29-9589-5543e92d2f72 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] [instance: 0fc7bec3-39c9-4048-a84e-914159181e7d] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:30:16.851758 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-c7d45cc6-cd05-4f29-9589-5543e92d2f72 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:30:16.852232 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-c7d45cc6-cd05-4f29-9589-5543e92d2f72 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:30:16.852660 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-c7d45cc6-cd05-4f29-9589-5543e92d2f72 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:30:16.853342 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-c7d45cc6-cd05-4f29-9589-5543e92d2f72 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:30:16.853822 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-c7d45cc6-cd05-4f29-9589-5543e92d2f72 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:30:16.854241 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-c7d45cc6-cd05-4f29-9589-5543e92d2f72 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:30:16.858321 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG dbcounter [-] [118727] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:30:16.995597 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-c7d45cc6-cd05-4f29-9589-5543e92d2f72 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16778b0dd21d41eeaa6087b67931eef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba9bc456234ea6ade63d41a1624967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:30:17.003114 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-c7d45cc6-cd05-4f29-9589-5543e92d2f72 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] 10.222.0.16 "GET /compute/v2.1/servers/0fc7bec3-39c9-4048-a84e-914159181e7d" status: 200 len: 1367 microversion: 2.1 time: 0.162671 Oct 31 19:30:17.003673 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 496/994] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:30:16 2022] GET /compute/v2.1/servers/0fc7bec3-39c9-4048-a84e-914159181e7d => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:30:18.025138 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-4044dc53-8e6b-4067-9469-fc3e59881513 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:30:18.025788 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-4044dc53-8e6b-4067-9469-fc3e59881513 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] [instance: 0fc7bec3-39c9-4048-a84e-914159181e7d] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:30:18.032246 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-4044dc53-8e6b-4067-9469-fc3e59881513 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:30:18.032727 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-4044dc53-8e6b-4067-9469-fc3e59881513 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:30:18.033165 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-4044dc53-8e6b-4067-9469-fc3e59881513 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:30:18.033888 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-4044dc53-8e6b-4067-9469-fc3e59881513 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:30:18.034350 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-4044dc53-8e6b-4067-9469-fc3e59881513 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:30:18.034778 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-4044dc53-8e6b-4067-9469-fc3e59881513 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:30:18.158749 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-4044dc53-8e6b-4067-9469-fc3e59881513 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16778b0dd21d41eeaa6087b67931eef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba9bc456234ea6ade63d41a1624967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:30:18.167106 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-4044dc53-8e6b-4067-9469-fc3e59881513 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] 10.222.0.16 "GET /compute/v2.1/servers/0fc7bec3-39c9-4048-a84e-914159181e7d" status: 200 len: 1367 microversion: 2.1 time: 0.145850 Oct 31 19:30:18.167670 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 499/995] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:30:18 2022] GET /compute/v2.1/servers/0fc7bec3-39c9-4048-a84e-914159181e7d => generated 1367 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:30:18.885934 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [req-687de651-da76-4f44-afdb-3a0d63e7dc01 req-9caf3e08-da14-4908-b175-af25bf604c42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fc7bec3-39c9-4048-a84e-914159181e7d", "name": "network-vif-plugged", "status": "completed", "tag": "a5625ca5-7f65-4381-bf93-f9cea628dbd1"}]} {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:30:18.896333 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [req-687de651-da76-4f44-afdb-3a0d63e7dc01 req-9caf3e08-da14-4908-b175-af25bf604c42 service nova] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:30:18.896755 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [req-687de651-da76-4f44-afdb-3a0d63e7dc01 req-9caf3e08-da14-4908-b175-af25bf604c42 service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:30:18.897175 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [req-687de651-da76-4f44-afdb-3a0d63e7dc01 req-9caf3e08-da14-4908-b175-af25bf604c42 service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:30:18.910238 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.compute.server_external_events [req-687de651-da76-4f44-afdb-3a0d63e7dc01 req-9caf3e08-da14-4908-b175-af25bf604c42 service nova] Creating event network-vif-plugged:a5625ca5-7f65-4381-bf93-f9cea628dbd1 for instance 0fc7bec3-39c9-4048-a84e-914159181e7d on hv-cinder-86309 Oct 31 19:30:18.915404 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [req-687de651-da76-4f44-afdb-3a0d63e7dc01 req-9caf3e08-da14-4908-b175-af25bf604c42 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033232 Oct 31 19:30:18.915985 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 497/996] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 31 19:30:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:30:19.189589 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-2c14bdda-d8e9-4e4f-a209-bb57227a9d52 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:30:19.190228 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-2c14bdda-d8e9-4e4f-a209-bb57227a9d52 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] [instance: 0fc7bec3-39c9-4048-a84e-914159181e7d] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:30:19.197122 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-2c14bdda-d8e9-4e4f-a209-bb57227a9d52 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:30:19.197619 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-2c14bdda-d8e9-4e4f-a209-bb57227a9d52 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:30:19.198062 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-2c14bdda-d8e9-4e4f-a209-bb57227a9d52 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:30:19.198753 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-2c14bdda-d8e9-4e4f-a209-bb57227a9d52 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:30:19.199207 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-2c14bdda-d8e9-4e4f-a209-bb57227a9d52 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:30:19.199631 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-2c14bdda-d8e9-4e4f-a209-bb57227a9d52 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:30:19.203605 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG dbcounter [-] [118726] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:30:19.330979 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-2c14bdda-d8e9-4e4f-a209-bb57227a9d52 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16778b0dd21d41eeaa6087b67931eef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba9bc456234ea6ade63d41a1624967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:30:19.338623 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-2c14bdda-d8e9-4e4f-a209-bb57227a9d52 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] 10.222.0.16 "GET /compute/v2.1/servers/0fc7bec3-39c9-4048-a84e-914159181e7d" status: 200 len: 1367 microversion: 2.1 time: 0.152896 Oct 31 19:30:19.339192 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 500/997] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:30:19 2022] GET /compute/v2.1/servers/0fc7bec3-39c9-4048-a84e-914159181e7d => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:30:20.361911 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-6501c0db-26fb-4976-929f-8fa56e775166 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:30:20.362635 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-6501c0db-26fb-4976-929f-8fa56e775166 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] [instance: 0fc7bec3-39c9-4048-a84e-914159181e7d] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:30:20.364564 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG dbcounter [-] [118727] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=118727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:30:20.370601 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-6501c0db-26fb-4976-929f-8fa56e775166 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:30:20.371172 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-6501c0db-26fb-4976-929f-8fa56e775166 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:30:20.371671 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-6501c0db-26fb-4976-929f-8fa56e775166 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:30:20.372532 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-6501c0db-26fb-4976-929f-8fa56e775166 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:30:20.373021 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-6501c0db-26fb-4976-929f-8fa56e775166 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:30:20.373451 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-6501c0db-26fb-4976-929f-8fa56e775166 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:30:20.501830 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-6501c0db-26fb-4976-929f-8fa56e775166 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16778b0dd21d41eeaa6087b67931eef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba9bc456234ea6ade63d41a1624967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:30:20.511017 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-6501c0db-26fb-4976-929f-8fa56e775166 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] 10.222.0.16 "GET /compute/v2.1/servers/0fc7bec3-39c9-4048-a84e-914159181e7d" status: 200 len: 1556 microversion: 2.1 time: 0.153793 Oct 31 19:30:20.511579 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 498/998] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:30:20 2022] GET /compute/v2.1/servers/0fc7bec3-39c9-4048-a84e-914159181e7d => generated 1556 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:30:20.533958 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-b812c7a3-9b9a-4e98-a525-feead8732fb4 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:30:20.534462 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-b812c7a3-9b9a-4e98-a525-feead8732fb4 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] [instance: 0fc7bec3-39c9-4048-a84e-914159181e7d] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:30:20.536731 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG dbcounter [-] [118726] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=118726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:30:20.548867 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-b812c7a3-9b9a-4e98-a525-feead8732fb4 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:30:20.549801 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-b812c7a3-9b9a-4e98-a525-feead8732fb4 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:30:20.550245 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-b812c7a3-9b9a-4e98-a525-feead8732fb4 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:30:20.551010 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-b812c7a3-9b9a-4e98-a525-feead8732fb4 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:30:20.551408 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-b812c7a3-9b9a-4e98-a525-feead8732fb4 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:30:20.552010 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-b812c7a3-9b9a-4e98-a525-feead8732fb4 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:30:20.644639 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-b812c7a3-9b9a-4e98-a525-feead8732fb4 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] 10.222.0.16 "GET /compute/v2.1/servers/0fc7bec3-39c9-4048-a84e-914159181e7d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.114444 Oct 31 19:30:20.645482 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 501/999] 10.222.0.16 () {58 vars in 1275 bytes} [Mon Oct 31 19:30:20 2022] GET /compute/v2.1/servers/0fc7bec3-39c9-4048-a84e-914159181e7d/os-interface => generated 284 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:30:21.567218 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [req-d06f8108-1a66-4e5c-b5c3-1b91451e044e req-aec58c19-9626-49b4-977a-49649a53bbcd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0fc7bec3-39c9-4048-a84e-914159181e7d", "tag": "a5625ca5-7f65-4381-bf93-f9cea628dbd1"}]} {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:30:21.572796 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG dbcounter [-] [118727] Writing DB stats nova_cell0:SELECT=6 {{(pid=118727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:30:21.579187 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [req-d06f8108-1a66-4e5c-b5c3-1b91451e044e req-aec58c19-9626-49b4-977a-49649a53bbcd service nova] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:30:21.579665 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [req-d06f8108-1a66-4e5c-b5c3-1b91451e044e req-aec58c19-9626-49b4-977a-49649a53bbcd service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:30:21.580089 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [req-d06f8108-1a66-4e5c-b5c3-1b91451e044e req-aec58c19-9626-49b4-977a-49649a53bbcd service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:30:21.590990 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.compute.server_external_events [req-d06f8108-1a66-4e5c-b5c3-1b91451e044e req-aec58c19-9626-49b4-977a-49649a53bbcd service nova] Creating event network-changed:a5625ca5-7f65-4381-bf93-f9cea628dbd1 for instance 0fc7bec3-39c9-4048-a84e-914159181e7d on hv-cinder-86309 Oct 31 19:30:21.595870 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [req-d06f8108-1a66-4e5c-b5c3-1b91451e044e req-aec58c19-9626-49b4-977a-49649a53bbcd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032264 Oct 31 19:30:21.596631 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 499/1000] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 31 19:30:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:30:53.921158 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG dbcounter [-] [118726] Writing DB stats nova_cell0:SELECT=2 {{(pid=118726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:30:53.922162 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG dbcounter [-] [118726] Writing DB stats nova_cell0:SELECT=6 {{(pid=118726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:30:53.923476 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG dbcounter [-] [118726] Writing DB stats nova_api:SELECT=1 {{(pid=118726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:30:53.924070 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG dbcounter [-] [118726] Writing DB stats nova_cell1:SELECT=8 {{(pid=118726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:30:53.927944 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-ebb3d23b-347d-42e5-979a-97f2a1ce7ed0 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:30:53.928438 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-ebb3d23b-347d-42e5-979a-97f2a1ce7ed0 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] [instance: 0fc7bec3-39c9-4048-a84e-914159181e7d] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:30:53.937541 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-ebb3d23b-347d-42e5-979a-97f2a1ce7ed0 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:30:53.938049 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-ebb3d23b-347d-42e5-979a-97f2a1ce7ed0 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:30:53.938491 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-ebb3d23b-347d-42e5-979a-97f2a1ce7ed0 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:30:53.939183 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-ebb3d23b-347d-42e5-979a-97f2a1ce7ed0 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:30:53.939636 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-ebb3d23b-347d-42e5-979a-97f2a1ce7ed0 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:30:53.940064 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-ebb3d23b-347d-42e5-979a-97f2a1ce7ed0 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:30:53.963606 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-ebb3d23b-347d-42e5-979a-97f2a1ce7ed0 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] 10.222.0.16 "GET /compute/v2.1/servers/0fc7bec3-39c9-4048-a84e-914159181e7d/ips" status: 200 len: 149 microversion: 2.1 time: 0.043078 Oct 31 19:30:53.964181 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 502/1001] 10.222.0.16 () {58 vars in 1248 bytes} [Mon Oct 31 19:30:53 2022] GET /compute/v2.1/servers/0fc7bec3-39c9-4048-a84e-914159181e7d/ips => generated 149 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:30:55.373937 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-3a098bfd-2abe-4182-8ba5-02af37e4105f tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f8cd03f9-a0b5-46cc-aa05-4fd57d8b1b5d"}} {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:30:55.376343 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-3a098bfd-2abe-4182-8ba5-02af37e4105f tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] [instance: 0fc7bec3-39c9-4048-a84e-914159181e7d] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:30:55.378760 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG dbcounter [-] [118727] Writing DB stats nova_api:SELECT=3 {{(pid=118727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:30:55.379445 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG dbcounter [-] [118727] Writing DB stats nova_cell1:SELECT=14 {{(pid=118727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:30:55.386280 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-3a098bfd-2abe-4182-8ba5-02af37e4105f tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:30:55.386757 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-3a098bfd-2abe-4182-8ba5-02af37e4105f tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:30:55.387246 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-3a098bfd-2abe-4182-8ba5-02af37e4105f tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:30:55.387937 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-3a098bfd-2abe-4182-8ba5-02af37e4105f tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:30:55.388384 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-3a098bfd-2abe-4182-8ba5-02af37e4105f tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:30:55.388801 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-3a098bfd-2abe-4182-8ba5-02af37e4105f tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:30:55.823236 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-3a098bfd-2abe-4182-8ba5-02af37e4105f tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] 10.222.0.16 "POST /compute/v2.1/servers/0fc7bec3-39c9-4048-a84e-914159181e7d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.452757 Oct 31 19:30:55.823930 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 500/1002] 10.222.0.16 () {60 vars in 1323 bytes} [Mon Oct 31 19:30:55 2022] POST /compute/v2.1/servers/0fc7bec3-39c9-4048-a84e-914159181e7d/os-volume_attachments => generated 194 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:31:02.301501 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-2fdea83d-1cf5-47e1-aecc-d543b68ed695 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f8cd03f9-a0b5-46cc-aa05-4fd57d8b1b5d"}} {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:31:02.304111 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-2fdea83d-1cf5-47e1-aecc-d543b68ed695 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] [instance: 0fc7bec3-39c9-4048-a84e-914159181e7d] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:31:02.311329 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-2fdea83d-1cf5-47e1-aecc-d543b68ed695 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:31:02.311807 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-2fdea83d-1cf5-47e1-aecc-d543b68ed695 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:31:02.312244 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-2fdea83d-1cf5-47e1-aecc-d543b68ed695 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:31:02.312933 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-2fdea83d-1cf5-47e1-aecc-d543b68ed695 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:31:02.313385 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-2fdea83d-1cf5-47e1-aecc-d543b68ed695 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:31:02.313843 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-2fdea83d-1cf5-47e1-aecc-d543b68ed695 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:31:02.441486 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.wsgi [None req-2fdea83d-1cf5-47e1-aecc-d543b68ed695 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] HTTP exception thrown: Invalid volume: volume f8cd03f9-a0b5-46cc-aa05-4fd57d8b1b5d is already attached to instances: 0fc7bec3-39c9-4048-a84e-914159181e7d Oct 31 19:31:02.443222 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-2fdea83d-1cf5-47e1-aecc-d543b68ed695 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Request method failure captured: Oct 31 19:31:02.443222 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: request: POST /compute/v2.1/servers/0fc7bec3-39c9-4048-a84e-914159181e7d/os-volume_attachments HTTP/1.1 Oct 31 19:31:02.443222 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: Accept: application/json Oct 31 19:31:02.443222 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: Accept-Encoding: identity Oct 31 19:31:02.443222 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: Connection: close Oct 31 19:31:02.443222 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: Content-Length: 74 Oct 31 19:31:02.443222 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: Content-Type: application/json Oct 31 19:31:02.443222 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: Host: 10.222.0.16 Oct 31 19:31:02.443222 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: Openstack-System-Scope: None Oct 31 19:31:02.443222 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: User-Agent: python-urllib3/1.26.12 Oct 31 19:31:02.443222 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Auth-Token: gAAAAABjYCG5aDHxCXWKl54hrIP8uylj79sP0BDeZd_ckOPD9KTXbM2ReEx2xP85m13HtVq0_y1CIML9YTOWHjoWbtPsbViKMinP0f-u0wr8bnwCjlILH4aKfybx_z4WSYI8NEE_nzlMlhmG0HnRtdfd3ZDvw9RFGweGeDxD4VM0dXtgMk2CUO4 Oct 31 19:31:02.443222 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Domain-Id: None Oct 31 19:31:02.443222 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Domain-Name: None Oct 31 19:31:02.443222 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Identity-Status: Confirmed Oct 31 19:31:02.443222 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Is-Admin-Project: True Oct 31 19:31:02.443222 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Project-Domain-Id: default Oct 31 19:31:02.443222 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Project-Domain-Name: Default Oct 31 19:31:02.443222 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Project-Id: adba9bc456234ea6ade63d41a1624967 Oct 31 19:31:02.443222 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Project-Name: tempest-AttachVolumeNegativeTest-1656947587 Oct 31 19:31:02.443222 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Role: member,reader Oct 31 19:31:02.443222 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Roles: member,reader Oct 31 19:31:02.444964 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/adba9bc456234ea6ade63d41a1624967"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_adba9bc456234ea6ade63d41a1624967", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/adba9bc456234ea6ade63d41a1624967"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/adba9bc456234ea6ade63d41a1624967"}]}] Oct 31 19:31:02.444964 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Tenant: tempest-AttachVolumeNegativeTest-1656947587 Oct 31 19:31:02.444964 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Tenant-Id: adba9bc456234ea6ade63d41a1624967 Oct 31 19:31:02.444964 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1656947587 Oct 31 19:31:02.444964 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-User: tempest-AttachVolumeNegativeTest-1656947587-project Oct 31 19:31:02.444964 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-User-Domain-Id: default Oct 31 19:31:02.444964 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-User-Domain-Name: Default Oct 31 19:31:02.444964 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-User-Id: 16778b0dd21d41eeaa6087b67931eef8 Oct 31 19:31:02.444964 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-User-Name: tempest-AttachVolumeNegativeTest-1656947587-project Oct 31 19:31:02.444964 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: Oct 31 19:31:02.444964 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: {"volumeAttachment": {"volumeId": "f8cd03f9-a0b5-46cc-aa05-4fd57d8b1b5d"}} Oct 31 19:31:02.444964 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: method: > Oct 31 19:31:02.445883 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: exception: Invalid volume: volume f8cd03f9-a0b5-46cc-aa05-4fd57d8b1b5d is already attached to instances: 0fc7bec3-39c9-4048-a84e-914159181e7d Oct 31 19:31:02.445883 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: action_args: {'server_id': '0fc7bec3-39c9-4048-a84e-914159181e7d', 'body': {'volumeAttachment': {'volumeId': 'f8cd03f9-a0b5-46cc-aa05-4fd57d8b1b5d'}}} Oct 31 19:31:02.445883 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 19:31:02.445883 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:31:02.445883 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 31 19:31:02.445883 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 31 19:31:02.445883 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 31 19:31:02.445883 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 31 19:31:02.445883 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 31 19:31:02.445883 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 31 19:31:02.445883 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 31 19:31:02.445883 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 31 19:31:02.445883 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 31 19:31:02.445883 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 31 19:31:02.445883 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume f8cd03f9-a0b5-46cc-aa05-4fd57d8b1b5d is already attached to instances: 0fc7bec3-39c9-4048-a84e-914159181e7d Oct 31 19:31:02.445883 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Oct 31 19:31:02.445883 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 19:31:02.445883 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Oct 31 19:31:02.445883 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:31:02.447390 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 19:31:02.447390 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 19:31:02.447390 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 19:31:02.447390 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 19:31:02.447390 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 19:31:02.447390 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 19:31:02.447390 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 19:31:02.447390 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 19:31:02.447390 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 19:31:02.447390 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 19:31:02.447390 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 19:31:02.447390 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 19:31:02.447390 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 31 19:31:02.447390 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 31 19:31:02.447390 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume f8cd03f9-a0b5-46cc-aa05-4fd57d8b1b5d is already attached to instances: 0fc7bec3-39c9-4048-a84e-914159181e7d Oct 31 19:31:02.447390 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Oct 31 19:31:02.447390 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 19:31:02.447390 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Oct 31 19:31:02.447390 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:31:02.447390 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 19:31:02.449761 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 19:31:02.449761 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 19:31:02.449761 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 19:31:02.449761 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume f8cd03f9-a0b5-46cc-aa05-4fd57d8b1b5d is already attached to instances: 0fc7bec3-39c9-4048-a84e-914159181e7d Oct 31 19:31:02.449761 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Oct 31 19:31:02.449761 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-2fdea83d-1cf5-47e1-aecc-d543b68ed695 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Returning 400 to user: Invalid volume: volume f8cd03f9-a0b5-46cc-aa05-4fd57d8b1b5d is already attached to instances: 0fc7bec3-39c9-4048-a84e-914159181e7d {{(pid=118726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 19:31:02.449761 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-2fdea83d-1cf5-47e1-aecc-d543b68ed695 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] 10.222.0.16 "POST /compute/v2.1/servers/0fc7bec3-39c9-4048-a84e-914159181e7d/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.147274 Oct 31 19:31:02.449761 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 503/1003] 10.222.0.16 () {60 vars in 1323 bytes} [Mon Oct 31 19:31:02 2022] POST /compute/v2.1/servers/0fc7bec3-39c9-4048-a84e-914159181e7d/os-volume_attachments => generated 174 bytes in 148 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 31 19:31:02.510900 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-3fc43387-c1ce-4c1d-b4a5-8a9e81aa8518 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:31:02.512208 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-3fc43387-c1ce-4c1d-b4a5-8a9e81aa8518 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] [instance: 0fc7bec3-39c9-4048-a84e-914159181e7d] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:31:02.518846 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-3fc43387-c1ce-4c1d-b4a5-8a9e81aa8518 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:31:02.519340 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-3fc43387-c1ce-4c1d-b4a5-8a9e81aa8518 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:31:02.519770 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-3fc43387-c1ce-4c1d-b4a5-8a9e81aa8518 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:31:02.520447 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-3fc43387-c1ce-4c1d-b4a5-8a9e81aa8518 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:31:02.520955 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-3fc43387-c1ce-4c1d-b4a5-8a9e81aa8518 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:31:02.521374 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-3fc43387-c1ce-4c1d-b4a5-8a9e81aa8518 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:31:02.600520 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.objects.instance [None req-3fc43387-c1ce-4c1d-b4a5-8a9e81aa8518 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lazy-loading 'services' on Instance uuid 0fc7bec3-39c9-4048-a84e-914159181e7d {{(pid=118727) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 19:31:02.670422 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-3fc43387-c1ce-4c1d-b4a5-8a9e81aa8518 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] 10.222.0.16 "DELETE /compute/v2.1/servers/0fc7bec3-39c9-4048-a84e-914159181e7d/os-volume_attachments/f8cd03f9-a0b5-46cc-aa05-4fd57d8b1b5d" status: 202 len: 0 microversion: 2.1 time: 0.164201 Oct 31 19:31:02.671006 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 501/1004] 10.222.0.16 () {58 vars in 1416 bytes} [Mon Oct 31 19:31:02 2022] DELETE /compute/v2.1/servers/0fc7bec3-39c9-4048-a84e-914159181e7d/os-volume_attachments/f8cd03f9-a0b5-46cc-aa05-4fd57d8b1b5d => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 19:31:02.679496 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-777cefb8-0510-47be-a7f0-0e5396cd7d26 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:31:02.681640 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-777cefb8-0510-47be-a7f0-0e5396cd7d26 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] [instance: 0fc7bec3-39c9-4048-a84e-914159181e7d] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:31:02.691563 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-777cefb8-0510-47be-a7f0-0e5396cd7d26 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:31:02.692113 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-777cefb8-0510-47be-a7f0-0e5396cd7d26 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:31:02.692548 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-777cefb8-0510-47be-a7f0-0e5396cd7d26 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:31:02.693448 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-777cefb8-0510-47be-a7f0-0e5396cd7d26 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:31:02.694008 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-777cefb8-0510-47be-a7f0-0e5396cd7d26 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:31:02.694518 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-777cefb8-0510-47be-a7f0-0e5396cd7d26 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:31:02.726465 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-777cefb8-0510-47be-a7f0-0e5396cd7d26 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] 10.222.0.16 "GET /compute/v2.1/servers/0fc7bec3-39c9-4048-a84e-914159181e7d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050840 Oct 31 19:31:02.727090 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 504/1005] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Oct 31 19:31:02 2022] GET /compute/v2.1/servers/0fc7bec3-39c9-4048-a84e-914159181e7d/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 19:31:03.740131 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-04f319e0-f1d4-4a07-8889-edc6d3f1af07 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:31:03.742467 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-04f319e0-f1d4-4a07-8889-edc6d3f1af07 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] [instance: 0fc7bec3-39c9-4048-a84e-914159181e7d] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:31:03.748973 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-04f319e0-f1d4-4a07-8889-edc6d3f1af07 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:31:03.749450 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-04f319e0-f1d4-4a07-8889-edc6d3f1af07 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:31:03.749914 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-04f319e0-f1d4-4a07-8889-edc6d3f1af07 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:31:03.750588 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-04f319e0-f1d4-4a07-8889-edc6d3f1af07 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:31:03.751034 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-04f319e0-f1d4-4a07-8889-edc6d3f1af07 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:31:03.751450 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-04f319e0-f1d4-4a07-8889-edc6d3f1af07 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:31:03.780337 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-04f319e0-f1d4-4a07-8889-edc6d3f1af07 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] 10.222.0.16 "GET /compute/v2.1/servers/0fc7bec3-39c9-4048-a84e-914159181e7d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044508 Oct 31 19:31:03.780887 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 502/1006] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Oct 31 19:31:03 2022] GET /compute/v2.1/servers/0fc7bec3-39c9-4048-a84e-914159181e7d/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 19:31:03.842795 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-e6f0f568-2783-4825-95fd-cbb52996dd46 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:31:03.843281 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-e6f0f568-2783-4825-95fd-cbb52996dd46 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] [instance: 0fc7bec3-39c9-4048-a84e-914159181e7d] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:31:03.849550 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-e6f0f568-2783-4825-95fd-cbb52996dd46 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:31:03.850055 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-e6f0f568-2783-4825-95fd-cbb52996dd46 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:31:03.850487 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-e6f0f568-2783-4825-95fd-cbb52996dd46 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:31:03.851174 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-e6f0f568-2783-4825-95fd-cbb52996dd46 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:31:03.851657 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-e6f0f568-2783-4825-95fd-cbb52996dd46 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:31:03.852081 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-e6f0f568-2783-4825-95fd-cbb52996dd46 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:31:03.877560 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-e6f0f568-2783-4825-95fd-cbb52996dd46 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] [instance: 0fc7bec3-39c9-4048-a84e-914159181e7d] Going to try to terminate instance {{(pid=118726) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 19:31:03.951927 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-e6f0f568-2783-4825-95fd-cbb52996dd46 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] 10.222.0.16 "DELETE /compute/v2.1/servers/0fc7bec3-39c9-4048-a84e-914159181e7d" status: 204 len: 0 microversion: 2.1 time: 0.113446 Oct 31 19:31:03.952601 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 505/1007] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 31 19:31:03 2022] DELETE /compute/v2.1/servers/0fc7bec3-39c9-4048-a84e-914159181e7d => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 19:31:03.960700 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-501f0e60-33d6-45e5-858f-7948dd3723b6 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:31:03.961307 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-501f0e60-33d6-45e5-858f-7948dd3723b6 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] [instance: 0fc7bec3-39c9-4048-a84e-914159181e7d] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:31:03.967359 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-501f0e60-33d6-45e5-858f-7948dd3723b6 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:31:03.967838 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-501f0e60-33d6-45e5-858f-7948dd3723b6 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:31:03.968271 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-501f0e60-33d6-45e5-858f-7948dd3723b6 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:31:03.968952 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-501f0e60-33d6-45e5-858f-7948dd3723b6 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:31:03.969399 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-501f0e60-33d6-45e5-858f-7948dd3723b6 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:31:03.969944 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-501f0e60-33d6-45e5-858f-7948dd3723b6 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:31:04.098236 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-501f0e60-33d6-45e5-858f-7948dd3723b6 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16778b0dd21d41eeaa6087b67931eef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba9bc456234ea6ade63d41a1624967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:31:04.105812 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-501f0e60-33d6-45e5-858f-7948dd3723b6 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] 10.222.0.16 "GET /compute/v2.1/servers/0fc7bec3-39c9-4048-a84e-914159181e7d" status: 200 len: 1681 microversion: 2.1 time: 0.148921 Oct 31 19:31:04.106373 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 503/1008] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:31:03 2022] GET /compute/v2.1/servers/0fc7bec3-39c9-4048-a84e-914159181e7d => generated 1681 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 19:31:05.129425 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-483d7ab4-fd27-4985-84ff-d6cc333650dc tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:31:05.130159 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-483d7ab4-fd27-4985-84ff-d6cc333650dc tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] [instance: 0fc7bec3-39c9-4048-a84e-914159181e7d] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:31:05.137095 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-483d7ab4-fd27-4985-84ff-d6cc333650dc tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:31:05.137649 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-483d7ab4-fd27-4985-84ff-d6cc333650dc tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:31:05.138078 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-483d7ab4-fd27-4985-84ff-d6cc333650dc tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:31:05.138770 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-483d7ab4-fd27-4985-84ff-d6cc333650dc tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:31:05.139224 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-483d7ab4-fd27-4985-84ff-d6cc333650dc tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:31:05.139651 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-483d7ab4-fd27-4985-84ff-d6cc333650dc tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:31:05.268914 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-483d7ab4-fd27-4985-84ff-d6cc333650dc tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16778b0dd21d41eeaa6087b67931eef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba9bc456234ea6ade63d41a1624967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:31:05.276561 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-483d7ab4-fd27-4985-84ff-d6cc333650dc tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] 10.222.0.16 "GET /compute/v2.1/servers/0fc7bec3-39c9-4048-a84e-914159181e7d" status: 200 len: 1681 microversion: 2.1 time: 0.151384 Oct 31 19:31:05.277126 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 506/1009] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:31:05 2022] GET /compute/v2.1/servers/0fc7bec3-39c9-4048-a84e-914159181e7d => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:31:06.280289 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [req-a7cf29e0-50f0-42ff-9050-500333cf4b88 req-3e6da483-15d8-45ab-806c-9e85c959d2f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fc7bec3-39c9-4048-a84e-914159181e7d", "name": "network-vif-deleted", "tag": "a5625ca5-7f65-4381-bf93-f9cea628dbd1"}]} {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:31:06.291198 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [req-a7cf29e0-50f0-42ff-9050-500333cf4b88 req-3e6da483-15d8-45ab-806c-9e85c959d2f4 service nova] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:31:06.291677 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [req-a7cf29e0-50f0-42ff-9050-500333cf4b88 req-3e6da483-15d8-45ab-806c-9e85c959d2f4 service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:31:06.292101 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [req-a7cf29e0-50f0-42ff-9050-500333cf4b88 req-3e6da483-15d8-45ab-806c-9e85c959d2f4 service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:31:06.301824 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-17a3a7cd-4e1d-43cc-b57d-71aa8801e4d1 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:31:06.303238 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-17a3a7cd-4e1d-43cc-b57d-71aa8801e4d1 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] [instance: 0fc7bec3-39c9-4048-a84e-914159181e7d] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:31:06.304590 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.compute.server_external_events [req-a7cf29e0-50f0-42ff-9050-500333cf4b88 req-3e6da483-15d8-45ab-806c-9e85c959d2f4 service nova] Creating event network-vif-deleted:a5625ca5-7f65-4381-bf93-f9cea628dbd1 for instance 0fc7bec3-39c9-4048-a84e-914159181e7d on hv-cinder-86309 Oct 31 19:31:06.309711 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [req-a7cf29e0-50f0-42ff-9050-500333cf4b88 req-3e6da483-15d8-45ab-806c-9e85c959d2f4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033473 Oct 31 19:31:06.310518 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 504/1010] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 31 19:31:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:31:06.310822 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-17a3a7cd-4e1d-43cc-b57d-71aa8801e4d1 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:31:06.311423 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-17a3a7cd-4e1d-43cc-b57d-71aa8801e4d1 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:31:06.312075 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-17a3a7cd-4e1d-43cc-b57d-71aa8801e4d1 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:31:06.312840 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-17a3a7cd-4e1d-43cc-b57d-71aa8801e4d1 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:31:06.313386 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-17a3a7cd-4e1d-43cc-b57d-71aa8801e4d1 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:31:06.313842 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-17a3a7cd-4e1d-43cc-b57d-71aa8801e4d1 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:31:06.387778 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-17a3a7cd-4e1d-43cc-b57d-71aa8801e4d1 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16778b0dd21d41eeaa6087b67931eef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba9bc456234ea6ade63d41a1624967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:31:06.398966 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-17a3a7cd-4e1d-43cc-b57d-71aa8801e4d1 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] 10.222.0.16 "GET /compute/v2.1/servers/0fc7bec3-39c9-4048-a84e-914159181e7d" status: 200 len: 1326 microversion: 2.1 time: 0.101750 Oct 31 19:31:06.399596 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 507/1011] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:31:06 2022] GET /compute/v2.1/servers/0fc7bec3-39c9-4048-a84e-914159181e7d => generated 1326 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:31:07.424352 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-7a83c50f-8b9d-4d81-84d2-6b1ba1ab6fdb tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:31:07.425043 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-7a83c50f-8b9d-4d81-84d2-6b1ba1ab6fdb tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] [instance: 0fc7bec3-39c9-4048-a84e-914159181e7d] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:31:07.431164 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-7a83c50f-8b9d-4d81-84d2-6b1ba1ab6fdb tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:31:07.431638 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-7a83c50f-8b9d-4d81-84d2-6b1ba1ab6fdb tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:31:07.432068 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-7a83c50f-8b9d-4d81-84d2-6b1ba1ab6fdb tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:31:07.432749 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-7a83c50f-8b9d-4d81-84d2-6b1ba1ab6fdb tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:31:07.433198 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-7a83c50f-8b9d-4d81-84d2-6b1ba1ab6fdb tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:31:07.433643 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-7a83c50f-8b9d-4d81-84d2-6b1ba1ab6fdb tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:31:07.448509 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.wsgi [None req-7a83c50f-8b9d-4d81-84d2-6b1ba1ab6fdb tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] HTTP exception thrown: Instance 0fc7bec3-39c9-4048-a84e-914159181e7d could not be found. Oct 31 19:31:07.450160 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-7a83c50f-8b9d-4d81-84d2-6b1ba1ab6fdb tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Request method failure captured: Oct 31 19:31:07.450160 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: request: GET /compute/v2.1/servers/0fc7bec3-39c9-4048-a84e-914159181e7d HTTP/1.1 Oct 31 19:31:07.450160 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Accept: application/json Oct 31 19:31:07.450160 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Accept-Encoding: identity Oct 31 19:31:07.450160 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Connection: close Oct 31 19:31:07.450160 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Content-Length: 0 Oct 31 19:31:07.450160 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Content-Type: application/json Oct 31 19:31:07.450160 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Host: 10.222.0.16 Oct 31 19:31:07.450160 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Openstack-System-Scope: None Oct 31 19:31:07.450160 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: User-Agent: python-urllib3/1.26.12 Oct 31 19:31:07.450160 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Auth-Token: gAAAAABjYCG5aDHxCXWKl54hrIP8uylj79sP0BDeZd_ckOPD9KTXbM2ReEx2xP85m13HtVq0_y1CIML9YTOWHjoWbtPsbViKMinP0f-u0wr8bnwCjlILH4aKfybx_z4WSYI8NEE_nzlMlhmG0HnRtdfd3ZDvw9RFGweGeDxD4VM0dXtgMk2CUO4 Oct 31 19:31:07.450160 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Domain-Id: None Oct 31 19:31:07.450160 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Domain-Name: None Oct 31 19:31:07.450160 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Identity-Status: Confirmed Oct 31 19:31:07.450160 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Is-Admin-Project: True Oct 31 19:31:07.450160 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Project-Domain-Id: default Oct 31 19:31:07.450160 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Project-Domain-Name: Default Oct 31 19:31:07.450160 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Project-Id: adba9bc456234ea6ade63d41a1624967 Oct 31 19:31:07.450160 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Project-Name: tempest-AttachVolumeNegativeTest-1656947587 Oct 31 19:31:07.450160 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Role: member,reader Oct 31 19:31:07.450160 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Roles: member,reader Oct 31 19:31:07.451804 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/adba9bc456234ea6ade63d41a1624967"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_adba9bc456234ea6ade63d41a1624967", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/adba9bc456234ea6ade63d41a1624967"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/adba9bc456234ea6ade63d41a1624967"}]}] Oct 31 19:31:07.451804 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Tenant: tempest-AttachVolumeNegativeTest-1656947587 Oct 31 19:31:07.451804 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Tenant-Id: adba9bc456234ea6ade63d41a1624967 Oct 31 19:31:07.451804 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1656947587 Oct 31 19:31:07.451804 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User: tempest-AttachVolumeNegativeTest-1656947587-project Oct 31 19:31:07.451804 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User-Domain-Id: default Oct 31 19:31:07.451804 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User-Domain-Name: Default Oct 31 19:31:07.451804 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User-Id: 16778b0dd21d41eeaa6087b67931eef8 Oct 31 19:31:07.451804 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User-Name: tempest-AttachVolumeNegativeTest-1656947587-project Oct 31 19:31:07.451804 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: method: > Oct 31 19:31:07.451804 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: exception: Instance 0fc7bec3-39c9-4048-a84e-914159181e7d could not be found. Oct 31 19:31:07.451804 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: action_args: {'id': '0fc7bec3-39c9-4048-a84e-914159181e7d'} Oct 31 19:31:07.452925 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 19:31:07.452925 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:31:07.452925 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 19:31:07.452925 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 19:31:07.452925 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 19:31:07.452925 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 19:31:07.452925 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 19:31:07.452925 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 19:31:07.452925 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 19:31:07.452925 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 19:31:07.452925 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0fc7bec3-39c9-4048-a84e-914159181e7d could not be found. Oct 31 19:31:07.452925 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:31:07.452925 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 19:31:07.452925 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:31:07.452925 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:31:07.452925 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 19:31:07.452925 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 19:31:07.452925 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 19:31:07.452925 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 19:31:07.452925 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 19:31:07.454877 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 19:31:07.454877 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 19:31:07.454877 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 19:31:07.454877 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 19:31:07.454877 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 19:31:07.454877 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 19:31:07.454877 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 19:31:07.454877 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0fc7bec3-39c9-4048-a84e-914159181e7d could not be found. Oct 31 19:31:07.454877 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:31:07.454877 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 19:31:07.454877 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:31:07.454877 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:31:07.454877 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 19:31:07.454877 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 19:31:07.454877 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 19:31:07.454877 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 19:31:07.454877 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0fc7bec3-39c9-4048-a84e-914159181e7d could not be found. Oct 31 19:31:07.454877 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:31:07.456521 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-7a83c50f-8b9d-4d81-84d2-6b1ba1ab6fdb tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Returning 404 to user: Instance 0fc7bec3-39c9-4048-a84e-914159181e7d could not be found. {{(pid=118727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 19:31:07.456521 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-7a83c50f-8b9d-4d81-84d2-6b1ba1ab6fdb tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] 10.222.0.16 "GET /compute/v2.1/servers/0fc7bec3-39c9-4048-a84e-914159181e7d" status: 404 len: 111 microversion: 2.1 time: 0.031955 Oct 31 19:31:07.456521 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 505/1012] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:31:07 2022] GET /compute/v2.1/servers/0fc7bec3-39c9-4048-a84e-914159181e7d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 19:31:07.460306 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-881da3f8-041f-4e85-a6a0-e8efdae2084d tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Calling method '.version_select at 0x7f34f1eaa670>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:31:07.478397 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-881da3f8-041f-4e85-a6a0-e8efdae2084d tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1893997936" status: 202 len: 0 microversion: 2.1 time: 0.021934 Oct 31 19:31:07.478940 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 508/1013] 10.222.0.16 () {58 vars in 1221 bytes} [Mon Oct 31 19:31:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1893997936 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 19:31:08.071423 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-cd0198c7-fbe3-4e99-bf2f-4140c77fdbdb tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Action: 'create', calling method: .version_select at 0x7f34f5893dc0>, body: {"keypair": {"name": "tempest-keypair-145842299", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBe0W189tVklHrSuC7ZrwGIzQO3w50PTlmosrcbJSWcLxGnjo8IMR98Ft8Uv+osUaG+Vd+6TaUyxVwSVqYbhFpNPhklu3Xb5ztX+fyMkrJyqiNey/dr6dGeSKV6bN8WBag=="}} {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:31:08.086918 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.quota [None req-cd0198c7-fbe3-4e99-bf2f-4140c77fdbdb tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Getting quotas for project adba9bc456234ea6ade63d41a1624967. Resources: {'key_pairs'} {{(pid=118727) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 19:31:08.091318 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.quota [None req-cd0198c7-fbe3-4e99-bf2f-4140c77fdbdb tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Getting quotas for user 16778b0dd21d41eeaa6087b67931eef8 and project adba9bc456234ea6ade63d41a1624967. Resources: {'key_pairs'} {{(pid=118727) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 19:31:08.111897 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-cd0198c7-fbe3-4e99-bf2f-4140c77fdbdb tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.044397 Oct 31 19:31:08.112471 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 506/1014] 10.222.0.16 () {60 vars in 1159 bytes} [Mon Oct 31 19:31:08 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:31:09.024447 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [req-1836166e-2ffa-49d5-a62c-205d031a7dcc req-b2407cd0-b41e-4cf9-a5e1-a107698ca42a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f58f51e-138f-41b1-80d4-30cc500a9808", "tag": "cc59d509-dd78-46f7-93c5-fb58520f4ee4"}]} {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:31:09.031426 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-86ad80a7-4268-49cc-ac67-0dc819bb1fde tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:31:09.031932 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-86ad80a7-4268-49cc-ac67-0dc819bb1fde tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] [instance: 4f58f51e-138f-41b1-80d4-30cc500a9808] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:31:09.040014 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-86ad80a7-4268-49cc-ac67-0dc819bb1fde tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:31:09.040509 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-86ad80a7-4268-49cc-ac67-0dc819bb1fde tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:31:09.040948 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-86ad80a7-4268-49cc-ac67-0dc819bb1fde tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:31:09.041678 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-86ad80a7-4268-49cc-ac67-0dc819bb1fde tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:31:09.042141 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-86ad80a7-4268-49cc-ac67-0dc819bb1fde tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:31:09.042569 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-86ad80a7-4268-49cc-ac67-0dc819bb1fde tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:31:09.050162 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [req-1836166e-2ffa-49d5-a62c-205d031a7dcc req-b2407cd0-b41e-4cf9-a5e1-a107698ca42a service nova] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:31:09.050648 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [req-1836166e-2ffa-49d5-a62c-205d031a7dcc req-b2407cd0-b41e-4cf9-a5e1-a107698ca42a service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:31:09.051081 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [req-1836166e-2ffa-49d5-a62c-205d031a7dcc req-b2407cd0-b41e-4cf9-a5e1-a107698ca42a service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:31:09.063255 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.compute.server_external_events [req-1836166e-2ffa-49d5-a62c-205d031a7dcc req-b2407cd0-b41e-4cf9-a5e1-a107698ca42a service nova] Creating event network-changed:cc59d509-dd78-46f7-93c5-fb58520f4ee4 for instance 4f58f51e-138f-41b1-80d4-30cc500a9808 on hv-cinder-86309 Oct 31 19:31:09.069087 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [req-1836166e-2ffa-49d5-a62c-205d031a7dcc req-b2407cd0-b41e-4cf9-a5e1-a107698ca42a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048627 Oct 31 19:31:09.075844 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 507/1015] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 31 19:31:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:31:09.087861 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-86ad80a7-4268-49cc-ac67-0dc819bb1fde tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] [instance: 4f58f51e-138f-41b1-80d4-30cc500a9808] Going to try to terminate instance {{(pid=118726) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 19:31:09.186613 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-86ad80a7-4268-49cc-ac67-0dc819bb1fde tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4f58f51e-138f-41b1-80d4-30cc500a9808" status: 204 len: 0 microversion: 2.1 time: 0.170037 Oct 31 19:31:09.187155 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 509/1016] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 31 19:31:09 2022] DELETE /compute/v2.1/servers/4f58f51e-138f-41b1-80d4-30cc500a9808 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 19:31:09.197234 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-30667803-d34d-4151-979d-456d9bf54796 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:31:09.198955 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-30667803-d34d-4151-979d-456d9bf54796 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] [instance: 4f58f51e-138f-41b1-80d4-30cc500a9808] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:31:09.207927 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-30667803-d34d-4151-979d-456d9bf54796 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:31:09.208601 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-30667803-d34d-4151-979d-456d9bf54796 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:31:09.209059 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-30667803-d34d-4151-979d-456d9bf54796 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:31:09.210024 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-30667803-d34d-4151-979d-456d9bf54796 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:31:09.210787 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-30667803-d34d-4151-979d-456d9bf54796 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:31:09.211377 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-30667803-d34d-4151-979d-456d9bf54796 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:31:09.477085 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-30667803-d34d-4151-979d-456d9bf54796 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e73a60801b04fc7acc4260297fdd2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808cc3e5392b4bb7a80b154a60f69ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:31:09.486471 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-30667803-d34d-4151-979d-456d9bf54796 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] 10.222.0.16 "GET /compute/v2.1/servers/4f58f51e-138f-41b1-80d4-30cc500a9808" status: 200 len: 1573 microversion: 2.1 time: 0.294389 Oct 31 19:31:09.487249 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 508/1017] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:31:09 2022] GET /compute/v2.1/servers/4f58f51e-138f-41b1-80d4-30cc500a9808 => generated 1573 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:31:09.518766 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-76f6e88f-6705-401b-b1bc-4bcd07ef344d tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-343774735", "imageRef": "a9795ee0-6722-4e1e-8fc8-a6c2e68f3049", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fa342027-4076-4973-b2c6-612147f6fd68"}], "security_groups": [{"name": "tempest-securitygroup--238758193"}], "key_name": "tempest-keypair-145842299", "user_data": "}} {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:31:09.626874 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.network.neutron [None req-76f6e88f-6705-401b-b1bc-4bcd07ef344d tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] validate_networks() for [('fa342027-4076-4973-b2c6-612147f6fd68', None, None, None, None, None)] {{(pid=118726) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 19:31:10.000201 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.virt.hardware [None req-76f6e88f-6705-401b-b1bc-4bcd07ef344d tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Flavor limits 0:0:0 {{(pid=118726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 19:31:10.000616 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.virt.hardware [None req-76f6e88f-6705-401b-b1bc-4bcd07ef344d tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Image limits 0:0:0 {{(pid=118726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 19:31:10.001081 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.virt.hardware [None req-76f6e88f-6705-401b-b1bc-4bcd07ef344d tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Flavor pref 0:0:0 {{(pid=118726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 19:31:10.001479 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.virt.hardware [None req-76f6e88f-6705-401b-b1bc-4bcd07ef344d tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Image pref 0:0:0 {{(pid=118726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 19:31:10.001907 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.virt.hardware [None req-76f6e88f-6705-401b-b1bc-4bcd07ef344d tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 19:31:10.011049 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-76f6e88f-6705-401b-b1bc-4bcd07ef344d tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:31:10.011522 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-76f6e88f-6705-401b-b1bc-4bcd07ef344d tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:31:10.011947 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-76f6e88f-6705-401b-b1bc-4bcd07ef344d tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:31:10.012661 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-76f6e88f-6705-401b-b1bc-4bcd07ef344d tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:31:10.013129 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-76f6e88f-6705-401b-b1bc-4bcd07ef344d tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:31:10.013546 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-76f6e88f-6705-401b-b1bc-4bcd07ef344d tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:31:10.031300 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.quota [None req-76f6e88f-6705-401b-b1bc-4bcd07ef344d tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Getting quotas for project adba9bc456234ea6ade63d41a1624967. Resources: {'instances', 'ram', 'cores'} {{(pid=118726) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 19:31:10.035221 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.quota [None req-76f6e88f-6705-401b-b1bc-4bcd07ef344d tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Getting quotas for user 16778b0dd21d41eeaa6087b67931eef8 and project adba9bc456234ea6ade63d41a1624967. Resources: {'instances', 'ram', 'cores'} {{(pid=118726) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 19:31:10.047263 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-76f6e88f-6705-401b-b1bc-4bcd07ef344d tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Going to run 1 instances... {{(pid=118726) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 19:31:10.049721 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-76f6e88f-6705-401b-b1bc-4bcd07ef344d tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] [instance: 3cfc4366-d729-4c23-a899-d259f3afb325] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9795ee0-6722-4e1e-8fc8-a6c2e68f3049',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118726) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 19:31:10.098247 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-76f6e88f-6705-401b-b1bc-4bcd07ef344d tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.584119 Oct 31 19:31:10.099092 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 510/1018] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 31 19:31:09 2022] POST /compute/v2.1/servers => generated 401 bytes in 586 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 19:31:10.111177 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-973214b8-a9d8-4c32-a8ea-4329b48ee2ae tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:31:10.111784 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-973214b8-a9d8-4c32-a8ea-4329b48ee2ae tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] [instance: 3cfc4366-d729-4c23-a899-d259f3afb325] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:31:10.171669 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-973214b8-a9d8-4c32-a8ea-4329b48ee2ae tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16778b0dd21d41eeaa6087b67931eef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba9bc456234ea6ade63d41a1624967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:31:10.179393 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-973214b8-a9d8-4c32-a8ea-4329b48ee2ae tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] 10.222.0.16 "GET /compute/v2.1/servers/3cfc4366-d729-4c23-a899-d259f3afb325" status: 200 len: 1240 microversion: 2.1 time: 0.072181 Oct 31 19:31:10.179957 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 509/1019] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:31:10 2022] GET /compute/v2.1/servers/3cfc4366-d729-4c23-a899-d259f3afb325 => generated 1240 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:31:10.510572 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-0189c349-9983-431f-98d0-ade37e5a304c tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:31:10.511190 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-0189c349-9983-431f-98d0-ade37e5a304c tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] [instance: 4f58f51e-138f-41b1-80d4-30cc500a9808] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:31:10.518864 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-0189c349-9983-431f-98d0-ade37e5a304c tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:31:10.519350 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-0189c349-9983-431f-98d0-ade37e5a304c tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:31:10.519785 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-0189c349-9983-431f-98d0-ade37e5a304c tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:31:10.520484 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-0189c349-9983-431f-98d0-ade37e5a304c tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:31:10.521001 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-0189c349-9983-431f-98d0-ade37e5a304c tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:31:10.521431 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-0189c349-9983-431f-98d0-ade37e5a304c tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:31:10.657318 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-0189c349-9983-431f-98d0-ade37e5a304c tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e73a60801b04fc7acc4260297fdd2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808cc3e5392b4bb7a80b154a60f69ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:31:10.665843 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-0189c349-9983-431f-98d0-ade37e5a304c tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] 10.222.0.16 "GET /compute/v2.1/servers/4f58f51e-138f-41b1-80d4-30cc500a9808" status: 200 len: 1573 microversion: 2.1 time: 0.159267 Oct 31 19:31:10.666467 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 511/1020] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:31:10 2022] GET /compute/v2.1/servers/4f58f51e-138f-41b1-80d4-30cc500a9808 => generated 1573 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:31:11.203616 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-64dc7730-b5da-4f83-b6e1-fa66e21cc0ea tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:31:11.204470 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-64dc7730-b5da-4f83-b6e1-fa66e21cc0ea tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] [instance: 3cfc4366-d729-4c23-a899-d259f3afb325] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:31:11.212515 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-64dc7730-b5da-4f83-b6e1-fa66e21cc0ea tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:31:11.213108 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-64dc7730-b5da-4f83-b6e1-fa66e21cc0ea tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:31:11.213639 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-64dc7730-b5da-4f83-b6e1-fa66e21cc0ea tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:31:11.222024 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-64dc7730-b5da-4f83-b6e1-fa66e21cc0ea tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:31:11.222555 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-64dc7730-b5da-4f83-b6e1-fa66e21cc0ea tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:31:11.223008 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-64dc7730-b5da-4f83-b6e1-fa66e21cc0ea tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:31:11.312098 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-64dc7730-b5da-4f83-b6e1-fa66e21cc0ea tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16778b0dd21d41eeaa6087b67931eef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba9bc456234ea6ade63d41a1624967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:31:11.334974 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-64dc7730-b5da-4f83-b6e1-fa66e21cc0ea tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] 10.222.0.16 "GET /compute/v2.1/servers/3cfc4366-d729-4c23-a899-d259f3afb325" status: 200 len: 1300 microversion: 2.1 time: 0.135642 Oct 31 19:31:11.337799 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 510/1021] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:31:11 2022] GET /compute/v2.1/servers/3cfc4366-d729-4c23-a899-d259f3afb325 => generated 1300 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:31:11.559733 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [req-07e71fd6-f1b5-4953-a218-49a50978d105 req-796e85f6-796c-4e48-b468-3566eb1fa0f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f58f51e-138f-41b1-80d4-30cc500a9808", "name": "network-vif-deleted", "tag": "cc59d509-dd78-46f7-93c5-fb58520f4ee4"}]} {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:31:11.572526 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [req-07e71fd6-f1b5-4953-a218-49a50978d105 req-796e85f6-796c-4e48-b468-3566eb1fa0f5 service nova] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:31:11.572927 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [req-07e71fd6-f1b5-4953-a218-49a50978d105 req-796e85f6-796c-4e48-b468-3566eb1fa0f5 service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:31:11.573351 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [req-07e71fd6-f1b5-4953-a218-49a50978d105 req-796e85f6-796c-4e48-b468-3566eb1fa0f5 service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:31:11.586163 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.compute.server_external_events [req-07e71fd6-f1b5-4953-a218-49a50978d105 req-796e85f6-796c-4e48-b468-3566eb1fa0f5 service nova] Creating event network-vif-deleted:cc59d509-dd78-46f7-93c5-fb58520f4ee4 for instance 4f58f51e-138f-41b1-80d4-30cc500a9808 on hv-cinder-86309 Oct 31 19:31:11.592250 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [req-07e71fd6-f1b5-4953-a218-49a50978d105 req-796e85f6-796c-4e48-b468-3566eb1fa0f5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036899 Oct 31 19:31:11.592833 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 512/1022] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 31 19:31:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:31:11.690176 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-821589f4-ea10-46c2-8cdf-02f02441c7dc tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:31:11.691036 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-821589f4-ea10-46c2-8cdf-02f02441c7dc tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] [instance: 4f58f51e-138f-41b1-80d4-30cc500a9808] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:31:11.696862 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-821589f4-ea10-46c2-8cdf-02f02441c7dc tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:31:11.697411 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-821589f4-ea10-46c2-8cdf-02f02441c7dc tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:31:11.697940 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-821589f4-ea10-46c2-8cdf-02f02441c7dc tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:31:11.698690 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-821589f4-ea10-46c2-8cdf-02f02441c7dc tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:31:11.699150 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-821589f4-ea10-46c2-8cdf-02f02441c7dc tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:31:11.700299 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-821589f4-ea10-46c2-8cdf-02f02441c7dc tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:31:11.763841 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-821589f4-ea10-46c2-8cdf-02f02441c7dc tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e73a60801b04fc7acc4260297fdd2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808cc3e5392b4bb7a80b154a60f69ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:31:11.778518 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-821589f4-ea10-46c2-8cdf-02f02441c7dc tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] 10.222.0.16 "GET /compute/v2.1/servers/4f58f51e-138f-41b1-80d4-30cc500a9808" status: 200 len: 1224 microversion: 2.1 time: 0.092196 Oct 31 19:31:11.779680 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 511/1023] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:31:11 2022] GET /compute/v2.1/servers/4f58f51e-138f-41b1-80d4-30cc500a9808 => generated 1224 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:31:12.362798 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-966122c0-30c0-4b4a-9929-15c2f0eb4c3f tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:31:12.363493 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-966122c0-30c0-4b4a-9929-15c2f0eb4c3f tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] [instance: 3cfc4366-d729-4c23-a899-d259f3afb325] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:31:12.370230 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-966122c0-30c0-4b4a-9929-15c2f0eb4c3f tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:31:12.370717 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-966122c0-30c0-4b4a-9929-15c2f0eb4c3f tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:31:12.371182 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-966122c0-30c0-4b4a-9929-15c2f0eb4c3f tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:31:12.371925 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-966122c0-30c0-4b4a-9929-15c2f0eb4c3f tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:31:12.372566 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-966122c0-30c0-4b4a-9929-15c2f0eb4c3f tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:31:12.372999 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-966122c0-30c0-4b4a-9929-15c2f0eb4c3f tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:31:12.614729 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-966122c0-30c0-4b4a-9929-15c2f0eb4c3f tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16778b0dd21d41eeaa6087b67931eef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba9bc456234ea6ade63d41a1624967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:31:12.622556 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-966122c0-30c0-4b4a-9929-15c2f0eb4c3f tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] 10.222.0.16 "GET /compute/v2.1/servers/3cfc4366-d729-4c23-a899-d259f3afb325" status: 200 len: 1365 microversion: 2.1 time: 0.264162 Oct 31 19:31:12.623126 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 513/1024] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:31:12 2022] GET /compute/v2.1/servers/3cfc4366-d729-4c23-a899-d259f3afb325 => generated 1365 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 19:31:12.803122 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-0da4b011-4560-4ba6-b891-f2d9e3eca1aa tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:31:12.803826 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-0da4b011-4560-4ba6-b891-f2d9e3eca1aa tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] [instance: 4f58f51e-138f-41b1-80d4-30cc500a9808] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:31:12.810878 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-0da4b011-4560-4ba6-b891-f2d9e3eca1aa tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:31:12.811531 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-0da4b011-4560-4ba6-b891-f2d9e3eca1aa tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:31:12.811973 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-0da4b011-4560-4ba6-b891-f2d9e3eca1aa tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:31:12.812667 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-0da4b011-4560-4ba6-b891-f2d9e3eca1aa tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:31:12.813123 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-0da4b011-4560-4ba6-b891-f2d9e3eca1aa tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:31:12.813549 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-0da4b011-4560-4ba6-b891-f2d9e3eca1aa tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:31:12.828027 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.wsgi [None req-0da4b011-4560-4ba6-b891-f2d9e3eca1aa tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] HTTP exception thrown: Instance 4f58f51e-138f-41b1-80d4-30cc500a9808 could not be found. Oct 31 19:31:12.829701 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-0da4b011-4560-4ba6-b891-f2d9e3eca1aa tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Request method failure captured: Oct 31 19:31:12.829701 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: request: GET /compute/v2.1/servers/4f58f51e-138f-41b1-80d4-30cc500a9808 HTTP/1.1 Oct 31 19:31:12.829701 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Accept: application/json Oct 31 19:31:12.829701 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Accept-Encoding: identity Oct 31 19:31:12.829701 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Connection: close Oct 31 19:31:12.829701 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Content-Length: 0 Oct 31 19:31:12.829701 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Content-Type: application/json Oct 31 19:31:12.829701 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Host: 10.222.0.16 Oct 31 19:31:12.829701 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Openstack-System-Scope: None Oct 31 19:31:12.829701 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: User-Agent: python-urllib3/1.26.12 Oct 31 19:31:12.829701 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Auth-Token: gAAAAABjYCCEP_va2MgzPcthuSHgCO-BPB6CC52XadYYkIlt1kTr3a4jGaQpAoMWGCFpvXTcsn38gYUXHQZP7Pypanz3xtuz6RFPg-4WAMgRLoWDiY_wnErJHCB57XCJJPJMCE8jKET3LMMSL2hTR8Mlyuyt8G9Sd130QKwE-uUMJulgPVcVvCs Oct 31 19:31:12.829701 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Domain-Id: None Oct 31 19:31:12.829701 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Domain-Name: None Oct 31 19:31:12.829701 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Identity-Status: Confirmed Oct 31 19:31:12.829701 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Is-Admin-Project: True Oct 31 19:31:12.829701 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Project-Domain-Id: default Oct 31 19:31:12.829701 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Project-Domain-Name: Default Oct 31 19:31:12.829701 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Project-Id: 808cc3e5392b4bb7a80b154a60f69ee3 Oct 31 19:31:12.829701 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Project-Name: tempest-TestVolumeBootPattern-2094031800 Oct 31 19:31:12.829701 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Role: member,reader Oct 31 19:31:12.829701 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Roles: member,reader Oct 31 19:31:12.831381 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/808cc3e5392b4bb7a80b154a60f69ee3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_808cc3e5392b4bb7a80b154a60f69ee3", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/808cc3e5392b4bb7a80b154a60f69ee3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/808cc3e5392b4bb7a80b154a60f69ee3"}]}] Oct 31 19:31:12.831381 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Tenant: tempest-TestVolumeBootPattern-2094031800 Oct 31 19:31:12.831381 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Tenant-Id: 808cc3e5392b4bb7a80b154a60f69ee3 Oct 31 19:31:12.831381 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Tenant-Name: tempest-TestVolumeBootPattern-2094031800 Oct 31 19:31:12.831381 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User: tempest-TestVolumeBootPattern-2094031800-project Oct 31 19:31:12.831381 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User-Domain-Id: default Oct 31 19:31:12.831381 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User-Domain-Name: Default Oct 31 19:31:12.831381 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User-Id: 7e73a60801b04fc7acc4260297fdd2e4 Oct 31 19:31:12.831381 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User-Name: tempest-TestVolumeBootPattern-2094031800-project Oct 31 19:31:12.831381 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: method: > Oct 31 19:31:12.831381 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: exception: Instance 4f58f51e-138f-41b1-80d4-30cc500a9808 could not be found. Oct 31 19:31:12.831381 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: action_args: {'id': '4f58f51e-138f-41b1-80d4-30cc500a9808'} Oct 31 19:31:12.835829 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 19:31:12.835829 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:31:12.835829 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 19:31:12.835829 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 19:31:12.835829 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 19:31:12.835829 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 19:31:12.835829 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 19:31:12.835829 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 19:31:12.835829 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 19:31:12.835829 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 19:31:12.835829 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f58f51e-138f-41b1-80d4-30cc500a9808 could not be found. Oct 31 19:31:12.835829 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:31:12.835829 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 19:31:12.835829 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:31:12.835829 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:31:12.835829 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 19:31:12.835829 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 19:31:12.835829 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 19:31:12.835829 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 19:31:12.835829 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 19:31:12.838218 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 19:31:12.838218 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 19:31:12.838218 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 19:31:12.838218 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 19:31:12.838218 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 19:31:12.838218 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 19:31:12.838218 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 19:31:12.838218 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f58f51e-138f-41b1-80d4-30cc500a9808 could not be found. Oct 31 19:31:12.838218 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:31:12.838218 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 19:31:12.838218 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:31:12.838218 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:31:12.838218 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 19:31:12.838218 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 19:31:12.838218 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 19:31:12.838218 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 19:31:12.838218 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f58f51e-138f-41b1-80d4-30cc500a9808 could not be found. Oct 31 19:31:12.838218 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:31:12.840744 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-0da4b011-4560-4ba6-b891-f2d9e3eca1aa tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Returning 404 to user: Instance 4f58f51e-138f-41b1-80d4-30cc500a9808 could not be found. {{(pid=118727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 19:31:12.840744 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-0da4b011-4560-4ba6-b891-f2d9e3eca1aa tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] 10.222.0.16 "GET /compute/v2.1/servers/4f58f51e-138f-41b1-80d4-30cc500a9808" status: 404 len: 111 microversion: 2.1 time: 0.031884 Oct 31 19:31:12.840744 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 512/1025] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:31:12 2022] GET /compute/v2.1/servers/4f58f51e-138f-41b1-80d4-30cc500a9808 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 19:31:13.069748 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [req-86d3aea8-fca4-4e37-9315-27fa1c3c1266 req-b793ec18-94d0-49f8-8641-01973b8d03a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3cfc4366-d729-4c23-a899-d259f3afb325", "tag": "e5d1bcff-7800-4dd2-a9d0-e0dc8c39ca9e"}]} {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:31:13.079724 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [req-86d3aea8-fca4-4e37-9315-27fa1c3c1266 req-b793ec18-94d0-49f8-8641-01973b8d03a5 service nova] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:31:13.080426 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [req-86d3aea8-fca4-4e37-9315-27fa1c3c1266 req-b793ec18-94d0-49f8-8641-01973b8d03a5 service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:31:13.081020 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [req-86d3aea8-fca4-4e37-9315-27fa1c3c1266 req-b793ec18-94d0-49f8-8641-01973b8d03a5 service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:31:13.093945 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.compute.server_external_events [req-86d3aea8-fca4-4e37-9315-27fa1c3c1266 req-b793ec18-94d0-49f8-8641-01973b8d03a5 service nova] Creating event network-changed:e5d1bcff-7800-4dd2-a9d0-e0dc8c39ca9e for instance 3cfc4366-d729-4c23-a899-d259f3afb325 on hv-cinder-86309 Oct 31 19:31:13.099170 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [req-86d3aea8-fca4-4e37-9315-27fa1c3c1266 req-b793ec18-94d0-49f8-8641-01973b8d03a5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033104 Oct 31 19:31:13.099784 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 514/1026] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 31 19:31:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:31:13.646109 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-54d77d91-ba6b-48d5-8f9d-38679306fe61 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:31:13.646638 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-54d77d91-ba6b-48d5-8f9d-38679306fe61 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] [instance: 3cfc4366-d729-4c23-a899-d259f3afb325] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:31:13.652492 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-54d77d91-ba6b-48d5-8f9d-38679306fe61 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:31:13.652965 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-54d77d91-ba6b-48d5-8f9d-38679306fe61 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:31:13.653392 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-54d77d91-ba6b-48d5-8f9d-38679306fe61 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:31:13.654104 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-54d77d91-ba6b-48d5-8f9d-38679306fe61 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:31:13.654557 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-54d77d91-ba6b-48d5-8f9d-38679306fe61 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:31:13.654979 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-54d77d91-ba6b-48d5-8f9d-38679306fe61 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:31:13.783353 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-54d77d91-ba6b-48d5-8f9d-38679306fe61 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16778b0dd21d41eeaa6087b67931eef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba9bc456234ea6ade63d41a1624967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:31:13.791135 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-54d77d91-ba6b-48d5-8f9d-38679306fe61 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] 10.222.0.16 "GET /compute/v2.1/servers/3cfc4366-d729-4c23-a899-d259f3afb325" status: 200 len: 1365 microversion: 2.1 time: 0.148944 Oct 31 19:31:13.791687 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 513/1027] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:31:13 2022] GET /compute/v2.1/servers/3cfc4366-d729-4c23-a899-d259f3afb325 => generated 1365 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:31:14.815458 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-b32c4adb-73c1-4325-88a0-6a4a540b15c5 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:31:14.816175 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-b32c4adb-73c1-4325-88a0-6a4a540b15c5 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] [instance: 3cfc4366-d729-4c23-a899-d259f3afb325] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:31:14.822303 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-b32c4adb-73c1-4325-88a0-6a4a540b15c5 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:31:14.822782 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-b32c4adb-73c1-4325-88a0-6a4a540b15c5 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:31:14.823216 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-b32c4adb-73c1-4325-88a0-6a4a540b15c5 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:31:14.823898 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-b32c4adb-73c1-4325-88a0-6a4a540b15c5 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:31:14.824392 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-b32c4adb-73c1-4325-88a0-6a4a540b15c5 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:31:14.824825 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-b32c4adb-73c1-4325-88a0-6a4a540b15c5 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:31:14.951919 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-b32c4adb-73c1-4325-88a0-6a4a540b15c5 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16778b0dd21d41eeaa6087b67931eef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba9bc456234ea6ade63d41a1624967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:31:14.959542 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-b32c4adb-73c1-4325-88a0-6a4a540b15c5 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] 10.222.0.16 "GET /compute/v2.1/servers/3cfc4366-d729-4c23-a899-d259f3afb325" status: 200 len: 1365 microversion: 2.1 time: 0.148903 Oct 31 19:31:14.960096 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 515/1028] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:31:14 2022] GET /compute/v2.1/servers/3cfc4366-d729-4c23-a899-d259f3afb325 => generated 1365 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:31:15.888414 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-b32920e5-7265-4a94-9a9e-a72d1801300f tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:31:15.888998 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-b32920e5-7265-4a94-9a9e-a72d1801300f tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] [instance: 7e8be244-f6d6-40d1-9dba-6e0b134311ff] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:31:15.901693 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-b32920e5-7265-4a94-9a9e-a72d1801300f tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:31:15.902185 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-b32920e5-7265-4a94-9a9e-a72d1801300f tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:31:15.903133 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-b32920e5-7265-4a94-9a9e-a72d1801300f tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:31:15.903822 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-b32920e5-7265-4a94-9a9e-a72d1801300f tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:31:15.904278 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-b32920e5-7265-4a94-9a9e-a72d1801300f tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:31:15.904702 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-b32920e5-7265-4a94-9a9e-a72d1801300f tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:31:15.931279 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-b32920e5-7265-4a94-9a9e-a72d1801300f tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] [instance: 7e8be244-f6d6-40d1-9dba-6e0b134311ff] Going to try to terminate instance {{(pid=118727) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 19:31:15.965509 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [req-4a792d44-5fbf-4422-a7b0-6b651c20f4ba req-1b2b3183-7560-4de0-aebf-0fa021d9c74a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e8be244-f6d6-40d1-9dba-6e0b134311ff", "tag": "4c57cc47-4bb3-47b7-af6b-73c6816c7ed6"}]} {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:31:15.976575 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [req-4a792d44-5fbf-4422-a7b0-6b651c20f4ba req-1b2b3183-7560-4de0-aebf-0fa021d9c74a service nova] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:31:15.977274 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [req-4a792d44-5fbf-4422-a7b0-6b651c20f4ba req-1b2b3183-7560-4de0-aebf-0fa021d9c74a service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:31:15.977948 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [req-4a792d44-5fbf-4422-a7b0-6b651c20f4ba req-1b2b3183-7560-4de0-aebf-0fa021d9c74a service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:31:15.990170 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.compute.server_external_events [req-4a792d44-5fbf-4422-a7b0-6b651c20f4ba req-1b2b3183-7560-4de0-aebf-0fa021d9c74a service nova] Creating event network-changed:4c57cc47-4bb3-47b7-af6b-73c6816c7ed6 for instance 7e8be244-f6d6-40d1-9dba-6e0b134311ff on hv-cinder-86309 Oct 31 19:31:15.995604 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [req-4a792d44-5fbf-4422-a7b0-6b651c20f4ba req-1b2b3183-7560-4de0-aebf-0fa021d9c74a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105254 Oct 31 19:31:15.996510 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 516/1029] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 31 19:31:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:31:16.002835 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-b3b87ba7-e1a0-44d5-8938-3e61083f8f50 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:31:16.003607 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-b3b87ba7-e1a0-44d5-8938-3e61083f8f50 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] [instance: 3cfc4366-d729-4c23-a899-d259f3afb325] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:31:16.018128 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-b32920e5-7265-4a94-9a9e-a72d1801300f tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7e8be244-f6d6-40d1-9dba-6e0b134311ff" status: 204 len: 0 microversion: 2.1 time: 0.132949 Oct 31 19:31:16.019000 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-b3b87ba7-e1a0-44d5-8938-3e61083f8f50 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:31:16.019180 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 514/1030] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 31 19:31:15 2022] DELETE /compute/v2.1/servers/7e8be244-f6d6-40d1-9dba-6e0b134311ff => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 19:31:16.020533 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-b3b87ba7-e1a0-44d5-8938-3e61083f8f50 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:31:16.021152 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-b3b87ba7-e1a0-44d5-8938-3e61083f8f50 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:31:16.022107 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-b3b87ba7-e1a0-44d5-8938-3e61083f8f50 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:31:16.022558 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-b3b87ba7-e1a0-44d5-8938-3e61083f8f50 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:31:16.023933 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-b3b87ba7-e1a0-44d5-8938-3e61083f8f50 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:31:16.030407 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-7b0ac552-2708-4854-93f9-c3e001f7156f tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:31:16.031107 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-7b0ac552-2708-4854-93f9-c3e001f7156f tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] [instance: 7e8be244-f6d6-40d1-9dba-6e0b134311ff] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:31:16.039990 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-7b0ac552-2708-4854-93f9-c3e001f7156f tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:31:16.040685 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-7b0ac552-2708-4854-93f9-c3e001f7156f tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:31:16.041124 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-7b0ac552-2708-4854-93f9-c3e001f7156f tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:31:16.041872 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-7b0ac552-2708-4854-93f9-c3e001f7156f tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:31:16.042326 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-7b0ac552-2708-4854-93f9-c3e001f7156f tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:31:16.042806 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-7b0ac552-2708-4854-93f9-c3e001f7156f tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:31:16.172950 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-b3b87ba7-e1a0-44d5-8938-3e61083f8f50 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16778b0dd21d41eeaa6087b67931eef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba9bc456234ea6ade63d41a1624967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:31:16.181008 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-b3b87ba7-e1a0-44d5-8938-3e61083f8f50 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] 10.222.0.16 "GET /compute/v2.1/servers/3cfc4366-d729-4c23-a899-d259f3afb325" status: 200 len: 1365 microversion: 2.1 time: 0.182835 Oct 31 19:31:16.181961 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 517/1031] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:31:15 2022] GET /compute/v2.1/servers/3cfc4366-d729-4c23-a899-d259f3afb325 => generated 1365 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:31:16.193571 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-7b0ac552-2708-4854-93f9-c3e001f7156f tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e73a60801b04fc7acc4260297fdd2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808cc3e5392b4bb7a80b154a60f69ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:31:16.202298 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-7b0ac552-2708-4854-93f9-c3e001f7156f tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] 10.222.0.16 "GET /compute/v2.1/servers/7e8be244-f6d6-40d1-9dba-6e0b134311ff" status: 200 len: 1576 microversion: 2.1 time: 0.177903 Oct 31 19:31:16.202983 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 515/1032] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:31:16 2022] GET /compute/v2.1/servers/7e8be244-f6d6-40d1-9dba-6e0b134311ff => generated 1576 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:31:17.203571 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-b78cba53-daaa-4457-be95-5fa7e37b1b6b tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:31:17.204251 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-b78cba53-daaa-4457-be95-5fa7e37b1b6b tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] [instance: 3cfc4366-d729-4c23-a899-d259f3afb325] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:31:17.210729 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-b78cba53-daaa-4457-be95-5fa7e37b1b6b tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:31:17.211094 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-b78cba53-daaa-4457-be95-5fa7e37b1b6b tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:31:17.211521 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-b78cba53-daaa-4457-be95-5fa7e37b1b6b tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:31:17.212219 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-b78cba53-daaa-4457-be95-5fa7e37b1b6b tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:31:17.212668 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-b78cba53-daaa-4457-be95-5fa7e37b1b6b tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:31:17.213092 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-b78cba53-daaa-4457-be95-5fa7e37b1b6b tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:31:17.228621 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-f54a133e-da91-41de-a023-e2b6826e8619 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:31:17.229340 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-f54a133e-da91-41de-a023-e2b6826e8619 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] [instance: 7e8be244-f6d6-40d1-9dba-6e0b134311ff] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:31:17.240709 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-f54a133e-da91-41de-a023-e2b6826e8619 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:31:17.241518 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-f54a133e-da91-41de-a023-e2b6826e8619 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:31:17.242943 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-f54a133e-da91-41de-a023-e2b6826e8619 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:31:17.243908 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-f54a133e-da91-41de-a023-e2b6826e8619 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:31:17.244470 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-f54a133e-da91-41de-a023-e2b6826e8619 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:31:17.245011 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-f54a133e-da91-41de-a023-e2b6826e8619 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:31:17.380561 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-b78cba53-daaa-4457-be95-5fa7e37b1b6b tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16778b0dd21d41eeaa6087b67931eef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba9bc456234ea6ade63d41a1624967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:31:17.388169 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-b78cba53-daaa-4457-be95-5fa7e37b1b6b tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] 10.222.0.16 "GET /compute/v2.1/servers/3cfc4366-d729-4c23-a899-d259f3afb325" status: 200 len: 1365 microversion: 2.1 time: 0.188491 Oct 31 19:31:17.388899 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 518/1033] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:31:17 2022] GET /compute/v2.1/servers/3cfc4366-d729-4c23-a899-d259f3afb325 => generated 1365 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:31:17.396141 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-f54a133e-da91-41de-a023-e2b6826e8619 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e73a60801b04fc7acc4260297fdd2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808cc3e5392b4bb7a80b154a60f69ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:31:17.405991 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-f54a133e-da91-41de-a023-e2b6826e8619 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] 10.222.0.16 "GET /compute/v2.1/servers/7e8be244-f6d6-40d1-9dba-6e0b134311ff" status: 200 len: 1576 microversion: 2.1 time: 0.182706 Oct 31 19:31:17.406558 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 516/1034] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:31:17 2022] GET /compute/v2.1/servers/7e8be244-f6d6-40d1-9dba-6e0b134311ff => generated 1576 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:31:18.010869 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [req-4d685e13-4e9d-4a36-aab3-02a15820350f req-a428b69a-844e-4d89-b43b-60d722ebc7d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e8be244-f6d6-40d1-9dba-6e0b134311ff", "name": "network-vif-deleted", "tag": "4c57cc47-4bb3-47b7-af6b-73c6816c7ed6"}]} {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:31:18.020614 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [req-4d685e13-4e9d-4a36-aab3-02a15820350f req-a428b69a-844e-4d89-b43b-60d722ebc7d2 service nova] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:31:18.021265 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [req-4d685e13-4e9d-4a36-aab3-02a15820350f req-a428b69a-844e-4d89-b43b-60d722ebc7d2 service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:31:18.021708 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [req-4d685e13-4e9d-4a36-aab3-02a15820350f req-a428b69a-844e-4d89-b43b-60d722ebc7d2 service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:31:18.025645 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG dbcounter [-] [118726] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:31:18.033884 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.compute.server_external_events [req-4d685e13-4e9d-4a36-aab3-02a15820350f req-a428b69a-844e-4d89-b43b-60d722ebc7d2 service nova] Creating event network-vif-deleted:4c57cc47-4bb3-47b7-af6b-73c6816c7ed6 for instance 7e8be244-f6d6-40d1-9dba-6e0b134311ff on hv-cinder-86309 Oct 31 19:31:18.038918 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [req-4d685e13-4e9d-4a36-aab3-02a15820350f req-a428b69a-844e-4d89-b43b-60d722ebc7d2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031359 Oct 31 19:31:18.039483 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 519/1035] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 31 19:31:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:31:18.411209 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-621fd773-6e1d-42fc-bbc9-f655139aadca tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:31:18.411817 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-621fd773-6e1d-42fc-bbc9-f655139aadca tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] [instance: 3cfc4366-d729-4c23-a899-d259f3afb325] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:31:18.418447 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-621fd773-6e1d-42fc-bbc9-f655139aadca tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:31:18.418925 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-621fd773-6e1d-42fc-bbc9-f655139aadca tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:31:18.419356 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-621fd773-6e1d-42fc-bbc9-f655139aadca tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:31:18.420030 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-621fd773-6e1d-42fc-bbc9-f655139aadca tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:31:18.420483 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-621fd773-6e1d-42fc-bbc9-f655139aadca tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:31:18.420915 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-621fd773-6e1d-42fc-bbc9-f655139aadca tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:31:18.430976 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-b04b701e-4bd8-47b0-ae20-d20f6a39287d tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:31:18.431674 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-b04b701e-4bd8-47b0-ae20-d20f6a39287d tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] [instance: 7e8be244-f6d6-40d1-9dba-6e0b134311ff] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:31:18.438840 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-b04b701e-4bd8-47b0-ae20-d20f6a39287d tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:31:18.439311 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-b04b701e-4bd8-47b0-ae20-d20f6a39287d tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:31:18.439742 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-b04b701e-4bd8-47b0-ae20-d20f6a39287d tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:31:18.440425 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-b04b701e-4bd8-47b0-ae20-d20f6a39287d tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:31:18.440874 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-b04b701e-4bd8-47b0-ae20-d20f6a39287d tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:31:18.440993 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG dbcounter [-] [118727] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=118727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:31:18.441298 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-b04b701e-4bd8-47b0-ae20-d20f6a39287d tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:31:18.476928 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-b04b701e-4bd8-47b0-ae20-d20f6a39287d tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:31:18.477331 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-b04b701e-4bd8-47b0-ae20-d20f6a39287d tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:31:18.477845 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-b04b701e-4bd8-47b0-ae20-d20f6a39287d tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:31:18.478287 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.objects.instance [None req-b04b701e-4bd8-47b0-ae20-d20f6a39287d tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lazy-loading 'fault' on Instance uuid 7e8be244-f6d6-40d1-9dba-6e0b134311ff {{(pid=118726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 19:31:18.521270 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-b04b701e-4bd8-47b0-ae20-d20f6a39287d tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e73a60801b04fc7acc4260297fdd2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808cc3e5392b4bb7a80b154a60f69ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:31:18.529009 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-b04b701e-4bd8-47b0-ae20-d20f6a39287d tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] 10.222.0.16 "GET /compute/v2.1/servers/7e8be244-f6d6-40d1-9dba-6e0b134311ff" status: 200 len: 1229 microversion: 2.1 time: 0.102518 Oct 31 19:31:18.529573 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 520/1036] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:31:18 2022] GET /compute/v2.1/servers/7e8be244-f6d6-40d1-9dba-6e0b134311ff => generated 1229 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 19:31:18.563616 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-621fd773-6e1d-42fc-bbc9-f655139aadca tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16778b0dd21d41eeaa6087b67931eef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba9bc456234ea6ade63d41a1624967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:31:18.571742 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-621fd773-6e1d-42fc-bbc9-f655139aadca tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] 10.222.0.16 "GET /compute/v2.1/servers/3cfc4366-d729-4c23-a899-d259f3afb325" status: 200 len: 1365 microversion: 2.1 time: 0.164315 Oct 31 19:31:18.572313 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 517/1037] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:31:18 2022] GET /compute/v2.1/servers/3cfc4366-d729-4c23-a899-d259f3afb325 => generated 1365 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:31:19.242509 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [req-54487d78-80be-4f06-950d-0152cac8cf9d req-92bf5a2a-850e-4c22-9798-94e3a8cd14bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cfc4366-d729-4c23-a899-d259f3afb325", "name": "network-vif-plugged", "status": "completed", "tag": "e5d1bcff-7800-4dd2-a9d0-e0dc8c39ca9e"}]} {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:31:19.251845 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [req-54487d78-80be-4f06-950d-0152cac8cf9d req-92bf5a2a-850e-4c22-9798-94e3a8cd14bc service nova] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:31:19.252321 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [req-54487d78-80be-4f06-950d-0152cac8cf9d req-92bf5a2a-850e-4c22-9798-94e3a8cd14bc service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:31:19.252750 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [req-54487d78-80be-4f06-950d-0152cac8cf9d req-92bf5a2a-850e-4c22-9798-94e3a8cd14bc service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:31:19.264029 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.compute.server_external_events [req-54487d78-80be-4f06-950d-0152cac8cf9d req-92bf5a2a-850e-4c22-9798-94e3a8cd14bc service nova] Creating event network-vif-plugged:e5d1bcff-7800-4dd2-a9d0-e0dc8c39ca9e for instance 3cfc4366-d729-4c23-a899-d259f3afb325 on hv-cinder-86309 Oct 31 19:31:19.268768 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [req-54487d78-80be-4f06-950d-0152cac8cf9d req-92bf5a2a-850e-4c22-9798-94e3a8cd14bc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030036 Oct 31 19:31:19.269348 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 521/1038] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 31 19:31:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 19:31:19.552262 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-7ce0bc7a-a751-4056-a5d1-a2de2f88f218 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:31:19.552863 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-7ce0bc7a-a751-4056-a5d1-a2de2f88f218 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] [instance: 7e8be244-f6d6-40d1-9dba-6e0b134311ff] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:31:19.559188 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-7ce0bc7a-a751-4056-a5d1-a2de2f88f218 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:31:19.559661 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-7ce0bc7a-a751-4056-a5d1-a2de2f88f218 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:31:19.560085 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-7ce0bc7a-a751-4056-a5d1-a2de2f88f218 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:31:19.560760 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-7ce0bc7a-a751-4056-a5d1-a2de2f88f218 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:31:19.561211 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-7ce0bc7a-a751-4056-a5d1-a2de2f88f218 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:31:19.561640 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-7ce0bc7a-a751-4056-a5d1-a2de2f88f218 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:31:19.574919 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.wsgi [None req-7ce0bc7a-a751-4056-a5d1-a2de2f88f218 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] HTTP exception thrown: Instance 7e8be244-f6d6-40d1-9dba-6e0b134311ff could not be found. Oct 31 19:31:19.576548 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-7ce0bc7a-a751-4056-a5d1-a2de2f88f218 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Request method failure captured: Oct 31 19:31:19.576548 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: request: GET /compute/v2.1/servers/7e8be244-f6d6-40d1-9dba-6e0b134311ff HTTP/1.1 Oct 31 19:31:19.576548 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Accept: application/json Oct 31 19:31:19.576548 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Accept-Encoding: identity Oct 31 19:31:19.576548 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Connection: close Oct 31 19:31:19.576548 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Content-Length: 0 Oct 31 19:31:19.576548 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Content-Type: application/json Oct 31 19:31:19.576548 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Host: 10.222.0.16 Oct 31 19:31:19.576548 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Openstack-System-Scope: None Oct 31 19:31:19.576548 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: User-Agent: python-urllib3/1.26.12 Oct 31 19:31:19.576548 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Auth-Token: gAAAAABjYCCEP_va2MgzPcthuSHgCO-BPB6CC52XadYYkIlt1kTr3a4jGaQpAoMWGCFpvXTcsn38gYUXHQZP7Pypanz3xtuz6RFPg-4WAMgRLoWDiY_wnErJHCB57XCJJPJMCE8jKET3LMMSL2hTR8Mlyuyt8G9Sd130QKwE-uUMJulgPVcVvCs Oct 31 19:31:19.576548 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Domain-Id: None Oct 31 19:31:19.576548 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Domain-Name: None Oct 31 19:31:19.576548 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Identity-Status: Confirmed Oct 31 19:31:19.576548 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Is-Admin-Project: True Oct 31 19:31:19.576548 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Project-Domain-Id: default Oct 31 19:31:19.576548 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Project-Domain-Name: Default Oct 31 19:31:19.576548 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Project-Id: 808cc3e5392b4bb7a80b154a60f69ee3 Oct 31 19:31:19.576548 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Project-Name: tempest-TestVolumeBootPattern-2094031800 Oct 31 19:31:19.576548 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Role: member,reader Oct 31 19:31:19.576548 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Roles: member,reader Oct 31 19:31:19.578175 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/808cc3e5392b4bb7a80b154a60f69ee3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_808cc3e5392b4bb7a80b154a60f69ee3", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/808cc3e5392b4bb7a80b154a60f69ee3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/808cc3e5392b4bb7a80b154a60f69ee3"}]}] Oct 31 19:31:19.578175 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Tenant: tempest-TestVolumeBootPattern-2094031800 Oct 31 19:31:19.578175 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Tenant-Id: 808cc3e5392b4bb7a80b154a60f69ee3 Oct 31 19:31:19.578175 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Tenant-Name: tempest-TestVolumeBootPattern-2094031800 Oct 31 19:31:19.578175 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User: tempest-TestVolumeBootPattern-2094031800-project Oct 31 19:31:19.578175 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User-Domain-Id: default Oct 31 19:31:19.578175 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User-Domain-Name: Default Oct 31 19:31:19.578175 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User-Id: 7e73a60801b04fc7acc4260297fdd2e4 Oct 31 19:31:19.578175 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User-Name: tempest-TestVolumeBootPattern-2094031800-project Oct 31 19:31:19.578175 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: method: > Oct 31 19:31:19.578175 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: exception: Instance 7e8be244-f6d6-40d1-9dba-6e0b134311ff could not be found. Oct 31 19:31:19.578175 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: action_args: {'id': '7e8be244-f6d6-40d1-9dba-6e0b134311ff'} Oct 31 19:31:19.579032 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 19:31:19.579032 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:31:19.579032 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 19:31:19.579032 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 19:31:19.579032 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 19:31:19.579032 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 19:31:19.579032 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 19:31:19.579032 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 19:31:19.579032 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 19:31:19.579032 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 19:31:19.579032 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e8be244-f6d6-40d1-9dba-6e0b134311ff could not be found. Oct 31 19:31:19.579032 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:31:19.579032 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 19:31:19.579032 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:31:19.579032 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:31:19.579032 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 19:31:19.579032 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 19:31:19.579032 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 19:31:19.579032 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 19:31:19.579032 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 19:31:19.580412 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 19:31:19.580412 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 19:31:19.580412 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 19:31:19.580412 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 19:31:19.580412 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 19:31:19.580412 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 19:31:19.580412 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 19:31:19.580412 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e8be244-f6d6-40d1-9dba-6e0b134311ff could not be found. Oct 31 19:31:19.580412 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:31:19.580412 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 19:31:19.580412 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:31:19.580412 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:31:19.580412 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 19:31:19.580412 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 19:31:19.580412 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 19:31:19.580412 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 19:31:19.580412 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e8be244-f6d6-40d1-9dba-6e0b134311ff could not be found. Oct 31 19:31:19.580412 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:31:19.581786 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-7ce0bc7a-a751-4056-a5d1-a2de2f88f218 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Returning 404 to user: Instance 7e8be244-f6d6-40d1-9dba-6e0b134311ff could not be found. {{(pid=118727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 19:31:19.581786 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-7ce0bc7a-a751-4056-a5d1-a2de2f88f218 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] 10.222.0.16 "GET /compute/v2.1/servers/7e8be244-f6d6-40d1-9dba-6e0b134311ff" status: 404 len: 111 microversion: 2.1 time: 0.029581 Oct 31 19:31:19.581786 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 518/1039] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:31:19 2022] GET /compute/v2.1/servers/7e8be244-f6d6-40d1-9dba-6e0b134311ff => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 19:31:19.596235 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-bfecee3b-e6fc-4d15-bc7f-fff54bc94e9f tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:31:19.597070 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-bfecee3b-e6fc-4d15-bc7f-fff54bc94e9f tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] [instance: 3cfc4366-d729-4c23-a899-d259f3afb325] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:31:19.603197 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-bfecee3b-e6fc-4d15-bc7f-fff54bc94e9f tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:31:19.603678 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-bfecee3b-e6fc-4d15-bc7f-fff54bc94e9f tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:31:19.604111 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-bfecee3b-e6fc-4d15-bc7f-fff54bc94e9f tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:31:19.604796 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-bfecee3b-e6fc-4d15-bc7f-fff54bc94e9f tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:31:19.605250 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-bfecee3b-e6fc-4d15-bc7f-fff54bc94e9f tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:31:19.605703 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-bfecee3b-e6fc-4d15-bc7f-fff54bc94e9f tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:31:19.826630 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-bfecee3b-e6fc-4d15-bc7f-fff54bc94e9f tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16778b0dd21d41eeaa6087b67931eef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba9bc456234ea6ade63d41a1624967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:31:19.834252 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-bfecee3b-e6fc-4d15-bc7f-fff54bc94e9f tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] 10.222.0.16 "GET /compute/v2.1/servers/3cfc4366-d729-4c23-a899-d259f3afb325" status: 200 len: 1365 microversion: 2.1 time: 0.242624 Oct 31 19:31:19.834758 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 522/1040] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:31:19 2022] GET /compute/v2.1/servers/3cfc4366-d729-4c23-a899-d259f3afb325 => generated 1365 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:31:20.083087 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-aab6a57b-c7f8-4287-9760-e912c807a339 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:31:20.083614 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-aab6a57b-c7f8-4287-9760-e912c807a339 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] [instance: 31bf9c76-adbe-4c58-8d9e-f332e36f86db] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:31:20.089568 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-aab6a57b-c7f8-4287-9760-e912c807a339 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:31:20.090626 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-aab6a57b-c7f8-4287-9760-e912c807a339 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:31:20.091061 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-aab6a57b-c7f8-4287-9760-e912c807a339 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:31:20.091747 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-aab6a57b-c7f8-4287-9760-e912c807a339 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:31:20.092340 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-aab6a57b-c7f8-4287-9760-e912c807a339 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:31:20.092701 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-aab6a57b-c7f8-4287-9760-e912c807a339 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:31:20.106111 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.wsgi [None req-aab6a57b-c7f8-4287-9760-e912c807a339 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] HTTP exception thrown: Instance 31bf9c76-adbe-4c58-8d9e-f332e36f86db could not be found. Oct 31 19:31:20.107629 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-aab6a57b-c7f8-4287-9760-e912c807a339 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Request method failure captured: Oct 31 19:31:20.107629 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: request: DELETE /compute/v2.1/servers/31bf9c76-adbe-4c58-8d9e-f332e36f86db HTTP/1.1 Oct 31 19:31:20.107629 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Accept: application/json Oct 31 19:31:20.107629 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Accept-Encoding: identity Oct 31 19:31:20.107629 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Connection: close Oct 31 19:31:20.107629 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Content-Length: 0 Oct 31 19:31:20.107629 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Content-Type: application/json Oct 31 19:31:20.107629 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Host: 10.222.0.16 Oct 31 19:31:20.107629 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Openstack-System-Scope: None Oct 31 19:31:20.107629 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: User-Agent: python-urllib3/1.26.12 Oct 31 19:31:20.107629 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Auth-Token: gAAAAABjYCCEP_va2MgzPcthuSHgCO-BPB6CC52XadYYkIlt1kTr3a4jGaQpAoMWGCFpvXTcsn38gYUXHQZP7Pypanz3xtuz6RFPg-4WAMgRLoWDiY_wnErJHCB57XCJJPJMCE8jKET3LMMSL2hTR8Mlyuyt8G9Sd130QKwE-uUMJulgPVcVvCs Oct 31 19:31:20.107629 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Domain-Id: None Oct 31 19:31:20.107629 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Domain-Name: None Oct 31 19:31:20.107629 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Identity-Status: Confirmed Oct 31 19:31:20.107629 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Is-Admin-Project: True Oct 31 19:31:20.107629 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Project-Domain-Id: default Oct 31 19:31:20.107629 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Project-Domain-Name: Default Oct 31 19:31:20.107629 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Project-Id: 808cc3e5392b4bb7a80b154a60f69ee3 Oct 31 19:31:20.107629 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Project-Name: tempest-TestVolumeBootPattern-2094031800 Oct 31 19:31:20.107629 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Role: member,reader Oct 31 19:31:20.107629 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Roles: member,reader Oct 31 19:31:20.109242 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/808cc3e5392b4bb7a80b154a60f69ee3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_808cc3e5392b4bb7a80b154a60f69ee3", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/808cc3e5392b4bb7a80b154a60f69ee3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/808cc3e5392b4bb7a80b154a60f69ee3"}]}] Oct 31 19:31:20.109242 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Tenant: tempest-TestVolumeBootPattern-2094031800 Oct 31 19:31:20.109242 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Tenant-Id: 808cc3e5392b4bb7a80b154a60f69ee3 Oct 31 19:31:20.109242 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Tenant-Name: tempest-TestVolumeBootPattern-2094031800 Oct 31 19:31:20.109242 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User: tempest-TestVolumeBootPattern-2094031800-project Oct 31 19:31:20.109242 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User-Domain-Id: default Oct 31 19:31:20.109242 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User-Domain-Name: Default Oct 31 19:31:20.109242 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User-Id: 7e73a60801b04fc7acc4260297fdd2e4 Oct 31 19:31:20.109242 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User-Name: tempest-TestVolumeBootPattern-2094031800-project Oct 31 19:31:20.109242 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: method: > Oct 31 19:31:20.109242 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: exception: Instance 31bf9c76-adbe-4c58-8d9e-f332e36f86db could not be found. Oct 31 19:31:20.109242 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: action_args: {'id': '31bf9c76-adbe-4c58-8d9e-f332e36f86db'} Oct 31 19:31:20.110213 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 19:31:20.110213 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:31:20.110213 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 19:31:20.110213 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 19:31:20.110213 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 19:31:20.110213 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 19:31:20.110213 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 19:31:20.110213 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 19:31:20.110213 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 19:31:20.110213 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 19:31:20.110213 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31bf9c76-adbe-4c58-8d9e-f332e36f86db could not be found. Oct 31 19:31:20.110213 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:31:20.110213 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 19:31:20.110213 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:31:20.110213 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:31:20.110213 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 19:31:20.110213 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 19:31:20.110213 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 19:31:20.110213 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 19:31:20.110213 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 19:31:20.111722 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 19:31:20.111722 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 19:31:20.111722 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 19:31:20.111722 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 19:31:20.111722 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 19:31:20.111722 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 19:31:20.111722 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 19:31:20.111722 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 19:31:20.111722 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 19:31:20.111722 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31bf9c76-adbe-4c58-8d9e-f332e36f86db could not be found. Oct 31 19:31:20.111722 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:31:20.111722 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 19:31:20.111722 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:31:20.111722 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:31:20.111722 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 19:31:20.111722 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 19:31:20.111722 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 19:31:20.111722 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 19:31:20.111722 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31bf9c76-adbe-4c58-8d9e-f332e36f86db could not be found. Oct 31 19:31:20.111722 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:31:20.113263 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-aab6a57b-c7f8-4287-9760-e912c807a339 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Returning 404 to user: Instance 31bf9c76-adbe-4c58-8d9e-f332e36f86db could not be found. {{(pid=118727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 19:31:20.113263 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-aab6a57b-c7f8-4287-9760-e912c807a339 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] 10.222.0.16 "DELETE /compute/v2.1/servers/31bf9c76-adbe-4c58-8d9e-f332e36f86db" status: 404 len: 111 microversion: 2.1 time: 0.030027 Oct 31 19:31:20.113263 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 519/1041] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 31 19:31:20 2022] DELETE /compute/v2.1/servers/31bf9c76-adbe-4c58-8d9e-f332e36f86db => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 19:31:20.117677 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-d6d303e4-4acb-4113-8548-508a9c23ca50 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:31:20.118287 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-d6d303e4-4acb-4113-8548-508a9c23ca50 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] [instance: 31bf9c76-adbe-4c58-8d9e-f332e36f86db] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:31:20.120287 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG dbcounter [-] [118726] Writing DB stats nova_cell0:SELECT=2 {{(pid=118726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:31:20.120978 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG dbcounter [-] [118726] Writing DB stats nova_cell0:SELECT=6 {{(pid=118726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:31:20.127199 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-d6d303e4-4acb-4113-8548-508a9c23ca50 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:31:20.127680 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-d6d303e4-4acb-4113-8548-508a9c23ca50 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:31:20.128115 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-d6d303e4-4acb-4113-8548-508a9c23ca50 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:31:20.128799 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-d6d303e4-4acb-4113-8548-508a9c23ca50 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:31:20.129255 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-d6d303e4-4acb-4113-8548-508a9c23ca50 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:31:20.129709 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-d6d303e4-4acb-4113-8548-508a9c23ca50 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:31:20.143438 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.wsgi [None req-d6d303e4-4acb-4113-8548-508a9c23ca50 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] HTTP exception thrown: Instance 31bf9c76-adbe-4c58-8d9e-f332e36f86db could not be found. Oct 31 19:31:20.145173 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-d6d303e4-4acb-4113-8548-508a9c23ca50 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Request method failure captured: Oct 31 19:31:20.145173 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: request: GET /compute/v2.1/servers/31bf9c76-adbe-4c58-8d9e-f332e36f86db HTTP/1.1 Oct 31 19:31:20.145173 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: Accept: application/json Oct 31 19:31:20.145173 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: Accept-Encoding: identity Oct 31 19:31:20.145173 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: Connection: close Oct 31 19:31:20.145173 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: Content-Length: 0 Oct 31 19:31:20.145173 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: Content-Type: application/json Oct 31 19:31:20.145173 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: Host: 10.222.0.16 Oct 31 19:31:20.145173 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: Openstack-System-Scope: None Oct 31 19:31:20.145173 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: User-Agent: python-urllib3/1.26.12 Oct 31 19:31:20.145173 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Auth-Token: gAAAAABjYCCEP_va2MgzPcthuSHgCO-BPB6CC52XadYYkIlt1kTr3a4jGaQpAoMWGCFpvXTcsn38gYUXHQZP7Pypanz3xtuz6RFPg-4WAMgRLoWDiY_wnErJHCB57XCJJPJMCE8jKET3LMMSL2hTR8Mlyuyt8G9Sd130QKwE-uUMJulgPVcVvCs Oct 31 19:31:20.145173 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Domain-Id: None Oct 31 19:31:20.145173 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Domain-Name: None Oct 31 19:31:20.145173 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Identity-Status: Confirmed Oct 31 19:31:20.145173 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Is-Admin-Project: True Oct 31 19:31:20.145173 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Project-Domain-Id: default Oct 31 19:31:20.145173 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Project-Domain-Name: Default Oct 31 19:31:20.145173 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Project-Id: 808cc3e5392b4bb7a80b154a60f69ee3 Oct 31 19:31:20.145173 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Project-Name: tempest-TestVolumeBootPattern-2094031800 Oct 31 19:31:20.145173 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Role: member,reader Oct 31 19:31:20.145173 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Roles: member,reader Oct 31 19:31:20.146825 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/808cc3e5392b4bb7a80b154a60f69ee3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_808cc3e5392b4bb7a80b154a60f69ee3", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/808cc3e5392b4bb7a80b154a60f69ee3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/808cc3e5392b4bb7a80b154a60f69ee3"}]}] Oct 31 19:31:20.146825 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Tenant: tempest-TestVolumeBootPattern-2094031800 Oct 31 19:31:20.146825 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Tenant-Id: 808cc3e5392b4bb7a80b154a60f69ee3 Oct 31 19:31:20.146825 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Tenant-Name: tempest-TestVolumeBootPattern-2094031800 Oct 31 19:31:20.146825 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-User: tempest-TestVolumeBootPattern-2094031800-project Oct 31 19:31:20.146825 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-User-Domain-Id: default Oct 31 19:31:20.146825 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-User-Domain-Name: Default Oct 31 19:31:20.146825 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-User-Id: 7e73a60801b04fc7acc4260297fdd2e4 Oct 31 19:31:20.146825 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-User-Name: tempest-TestVolumeBootPattern-2094031800-project Oct 31 19:31:20.146825 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: method: > Oct 31 19:31:20.146825 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: exception: Instance 31bf9c76-adbe-4c58-8d9e-f332e36f86db could not be found. Oct 31 19:31:20.146825 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: action_args: {'id': '31bf9c76-adbe-4c58-8d9e-f332e36f86db'} Oct 31 19:31:20.147761 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 19:31:20.147761 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:31:20.147761 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 19:31:20.147761 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 19:31:20.147761 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 19:31:20.147761 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 19:31:20.147761 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 19:31:20.147761 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 19:31:20.147761 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 19:31:20.147761 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 19:31:20.147761 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31bf9c76-adbe-4c58-8d9e-f332e36f86db could not be found. Oct 31 19:31:20.147761 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Oct 31 19:31:20.147761 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 19:31:20.147761 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Oct 31 19:31:20.147761 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:31:20.147761 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 19:31:20.147761 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 19:31:20.147761 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 19:31:20.147761 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 19:31:20.147761 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 19:31:20.149263 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 19:31:20.149263 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 19:31:20.149263 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 19:31:20.149263 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 19:31:20.149263 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 19:31:20.149263 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 19:31:20.149263 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 19:31:20.149263 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31bf9c76-adbe-4c58-8d9e-f332e36f86db could not be found. Oct 31 19:31:20.149263 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Oct 31 19:31:20.149263 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 19:31:20.149263 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Oct 31 19:31:20.149263 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:31:20.149263 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 19:31:20.149263 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 19:31:20.149263 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 19:31:20.149263 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 19:31:20.149263 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31bf9c76-adbe-4c58-8d9e-f332e36f86db could not be found. Oct 31 19:31:20.149263 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Oct 31 19:31:20.150742 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-d6d303e4-4acb-4113-8548-508a9c23ca50 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Returning 404 to user: Instance 31bf9c76-adbe-4c58-8d9e-f332e36f86db could not be found. {{(pid=118726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 19:31:20.150742 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-d6d303e4-4acb-4113-8548-508a9c23ca50 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] 10.222.0.16 "GET /compute/v2.1/servers/31bf9c76-adbe-4c58-8d9e-f332e36f86db" status: 404 len: 111 microversion: 2.1 time: 0.032954 Oct 31 19:31:20.150742 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 523/1042] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:31:20 2022] GET /compute/v2.1/servers/31bf9c76-adbe-4c58-8d9e-f332e36f86db => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 19:31:20.856864 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-252b938f-9b81-4ca5-a637-bb067e6d0082 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:31:20.857595 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-252b938f-9b81-4ca5-a637-bb067e6d0082 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] [instance: 3cfc4366-d729-4c23-a899-d259f3afb325] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:31:20.859451 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG dbcounter [-] [118727] Writing DB stats nova_cell0:SELECT=6 {{(pid=118727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:31:20.865622 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-252b938f-9b81-4ca5-a637-bb067e6d0082 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:31:20.866116 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-252b938f-9b81-4ca5-a637-bb067e6d0082 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:31:20.866552 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-252b938f-9b81-4ca5-a637-bb067e6d0082 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:31:20.867246 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-252b938f-9b81-4ca5-a637-bb067e6d0082 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:31:20.867708 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-252b938f-9b81-4ca5-a637-bb067e6d0082 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:31:20.868134 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-252b938f-9b81-4ca5-a637-bb067e6d0082 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:31:21.001503 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-252b938f-9b81-4ca5-a637-bb067e6d0082 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16778b0dd21d41eeaa6087b67931eef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba9bc456234ea6ade63d41a1624967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:31:21.009006 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-252b938f-9b81-4ca5-a637-bb067e6d0082 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] 10.222.0.16 "GET /compute/v2.1/servers/3cfc4366-d729-4c23-a899-d259f3afb325" status: 200 len: 1555 microversion: 2.1 time: 0.156627 Oct 31 19:31:21.009563 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 520/1043] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:31:20 2022] GET /compute/v2.1/servers/3cfc4366-d729-4c23-a899-d259f3afb325 => generated 1555 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:31:21.030723 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-4350b6ac-73ad-4acd-a72d-0cbcde23e1a8 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:31:21.031207 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-4350b6ac-73ad-4acd-a72d-0cbcde23e1a8 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] [instance: 3cfc4366-d729-4c23-a899-d259f3afb325] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:31:21.037595 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-4350b6ac-73ad-4acd-a72d-0cbcde23e1a8 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:31:21.038093 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-4350b6ac-73ad-4acd-a72d-0cbcde23e1a8 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:31:21.038782 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-4350b6ac-73ad-4acd-a72d-0cbcde23e1a8 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:31:21.039460 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-4350b6ac-73ad-4acd-a72d-0cbcde23e1a8 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:31:21.039909 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-4350b6ac-73ad-4acd-a72d-0cbcde23e1a8 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:31:21.040325 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-4350b6ac-73ad-4acd-a72d-0cbcde23e1a8 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:31:21.116444 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-4350b6ac-73ad-4acd-a72d-0cbcde23e1a8 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] 10.222.0.16 "GET /compute/v2.1/servers/3cfc4366-d729-4c23-a899-d259f3afb325/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.089506 Oct 31 19:31:21.117480 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 524/1044] 10.222.0.16 () {58 vars in 1275 bytes} [Mon Oct 31 19:31:21 2022] GET /compute/v2.1/servers/3cfc4366-d729-4c23-a899-d259f3afb325/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:31:21.440927 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-0bfa225c-7527-4c69-a056-8063eb0d3a66 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] Calling method '.version_select at 0x7f34f58e2430>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:31:21.464385 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-0bfa225c-7527-4c69-a056-8063eb0d3a66 tempest-TestVolumeBootPattern-2094031800 tempest-TestVolumeBootPattern-2094031800-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-298495679" status: 202 len: 0 microversion: 2.1 time: 0.027313 Oct 31 19:31:21.469325 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 521/1045] 10.222.0.16 () {58 vars in 1260 bytes} [Mon Oct 31 19:31:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-298495679 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 19:31:22.660571 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [req-05913b0f-76dd-47aa-a9f8-45ae63aafcd0 req-fd84f024-c70d-4978-8f2a-f3fa022f826f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3cfc4366-d729-4c23-a899-d259f3afb325", "tag": "e5d1bcff-7800-4dd2-a9d0-e0dc8c39ca9e"}]} {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:31:22.671494 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [req-05913b0f-76dd-47aa-a9f8-45ae63aafcd0 req-fd84f024-c70d-4978-8f2a-f3fa022f826f service nova] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:31:22.672057 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [req-05913b0f-76dd-47aa-a9f8-45ae63aafcd0 req-fd84f024-c70d-4978-8f2a-f3fa022f826f service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:31:22.672556 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [req-05913b0f-76dd-47aa-a9f8-45ae63aafcd0 req-fd84f024-c70d-4978-8f2a-f3fa022f826f service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:31:22.684516 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.compute.server_external_events [req-05913b0f-76dd-47aa-a9f8-45ae63aafcd0 req-fd84f024-c70d-4978-8f2a-f3fa022f826f service nova] Creating event network-changed:e5d1bcff-7800-4dd2-a9d0-e0dc8c39ca9e for instance 3cfc4366-d729-4c23-a899-d259f3afb325 on hv-cinder-86309 Oct 31 19:31:22.689647 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [req-05913b0f-76dd-47aa-a9f8-45ae63aafcd0 req-fd84f024-c70d-4978-8f2a-f3fa022f826f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033280 Oct 31 19:31:22.690494 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 525/1046] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 31 19:31:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:31:56.861939 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG dbcounter [-] [118727] Writing DB stats nova_cell1:SELECT=12 {{(pid=118727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:31:56.862707 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG dbcounter [-] [118727] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=1,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:31:56.866898 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-198ba3c8-90dd-41e7-b952-9fabadf479bf tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:31:56.867388 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-198ba3c8-90dd-41e7-b952-9fabadf479bf tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] [instance: 3cfc4366-d729-4c23-a899-d259f3afb325] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:31:56.874505 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-198ba3c8-90dd-41e7-b952-9fabadf479bf tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:31:56.874989 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-198ba3c8-90dd-41e7-b952-9fabadf479bf tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:31:56.875430 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-198ba3c8-90dd-41e7-b952-9fabadf479bf tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:31:56.876118 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-198ba3c8-90dd-41e7-b952-9fabadf479bf tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:31:56.876593 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-198ba3c8-90dd-41e7-b952-9fabadf479bf tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:31:56.877004 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-198ba3c8-90dd-41e7-b952-9fabadf479bf tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:31:56.901992 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-198ba3c8-90dd-41e7-b952-9fabadf479bf tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] 10.222.0.16 "GET /compute/v2.1/servers/3cfc4366-d729-4c23-a899-d259f3afb325/ips" status: 200 len: 150 microversion: 2.1 time: 0.041800 Oct 31 19:31:56.903191 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 522/1047] 10.222.0.16 () {58 vars in 1248 bytes} [Mon Oct 31 19:31:56 2022] GET /compute/v2.1/servers/3cfc4366-d729-4c23-a899-d259f3afb325/ips => generated 150 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:31:58.231390 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG dbcounter [-] [118726] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=118726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:31:58.232127 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG dbcounter [-] [118726] Writing DB stats nova_cell1:SELECT=24 {{(pid=118726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:31:58.236769 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-fff2f557-8a3c-4b5a-a837-acf3f87108c0 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d340d1e2-6560-4961-8557-70e0e30c25e8"}} {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:31:58.239195 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-fff2f557-8a3c-4b5a-a837-acf3f87108c0 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] [instance: 3cfc4366-d729-4c23-a899-d259f3afb325] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:31:58.246862 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-fff2f557-8a3c-4b5a-a837-acf3f87108c0 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:31:58.247335 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-fff2f557-8a3c-4b5a-a837-acf3f87108c0 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:31:58.247760 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-fff2f557-8a3c-4b5a-a837-acf3f87108c0 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:31:58.248436 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-fff2f557-8a3c-4b5a-a837-acf3f87108c0 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:31:58.248931 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-fff2f557-8a3c-4b5a-a837-acf3f87108c0 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:31:58.249324 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-fff2f557-8a3c-4b5a-a837-acf3f87108c0 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:31:58.482177 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-fff2f557-8a3c-4b5a-a837-acf3f87108c0 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] 10.222.0.16 "POST /compute/v2.1/servers/3cfc4366-d729-4c23-a899-d259f3afb325/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.252370 Oct 31 19:31:58.482770 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 526/1048] 10.222.0.16 () {60 vars in 1323 bytes} [Mon Oct 31 19:31:58 2022] POST /compute/v2.1/servers/3cfc4366-d729-4c23-a899-d259f3afb325/os-volume_attachments => generated 194 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:32:05.055176 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-2fe4d887-ed97-4143-ae4f-2b94198984d9 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:32:05.055716 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-2fe4d887-ed97-4143-ae4f-2b94198984d9 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] [instance: 3cfc4366-d729-4c23-a899-d259f3afb325] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:32:05.062401 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-2fe4d887-ed97-4143-ae4f-2b94198984d9 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:32:05.062881 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-2fe4d887-ed97-4143-ae4f-2b94198984d9 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:32:05.063567 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-2fe4d887-ed97-4143-ae4f-2b94198984d9 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:32:05.063991 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-2fe4d887-ed97-4143-ae4f-2b94198984d9 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:32:05.064440 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-2fe4d887-ed97-4143-ae4f-2b94198984d9 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:32:05.064863 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-2fe4d887-ed97-4143-ae4f-2b94198984d9 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:32:05.144259 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.objects.instance [None req-2fe4d887-ed97-4143-ae4f-2b94198984d9 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lazy-loading 'services' on Instance uuid 3cfc4366-d729-4c23-a899-d259f3afb325 {{(pid=118727) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 19:32:05.215420 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-2fe4d887-ed97-4143-ae4f-2b94198984d9 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] 10.222.0.16 "DELETE /compute/v2.1/servers/3cfc4366-d729-4c23-a899-d259f3afb325/os-volume_attachments/d340d1e2-6560-4961-8557-70e0e30c25e8" status: 202 len: 0 microversion: 2.1 time: 0.164090 Oct 31 19:32:05.215973 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 523/1049] 10.222.0.16 () {58 vars in 1416 bytes} [Mon Oct 31 19:32:05 2022] DELETE /compute/v2.1/servers/3cfc4366-d729-4c23-a899-d259f3afb325/os-volume_attachments/d340d1e2-6560-4961-8557-70e0e30c25e8 => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 19:32:05.224927 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-85d4a6e6-8c12-427e-a9d2-7cfb0e100797 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:32:05.227407 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-85d4a6e6-8c12-427e-a9d2-7cfb0e100797 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] [instance: 3cfc4366-d729-4c23-a899-d259f3afb325] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:32:05.234723 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-85d4a6e6-8c12-427e-a9d2-7cfb0e100797 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:32:05.235211 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-85d4a6e6-8c12-427e-a9d2-7cfb0e100797 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:32:05.235633 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-85d4a6e6-8c12-427e-a9d2-7cfb0e100797 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:32:05.236323 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-85d4a6e6-8c12-427e-a9d2-7cfb0e100797 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:32:05.236845 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-85d4a6e6-8c12-427e-a9d2-7cfb0e100797 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:32:05.237264 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-85d4a6e6-8c12-427e-a9d2-7cfb0e100797 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:32:05.267877 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-85d4a6e6-8c12-427e-a9d2-7cfb0e100797 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] 10.222.0.16 "GET /compute/v2.1/servers/3cfc4366-d729-4c23-a899-d259f3afb325/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047229 Oct 31 19:32:05.268428 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 527/1050] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Oct 31 19:32:05 2022] GET /compute/v2.1/servers/3cfc4366-d729-4c23-a899-d259f3afb325/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 19:32:06.281288 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-a0db4f94-9c94-452c-8783-df20fbd44f2f tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:32:06.283652 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-a0db4f94-9c94-452c-8783-df20fbd44f2f tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] [instance: 3cfc4366-d729-4c23-a899-d259f3afb325] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:32:06.290024 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-a0db4f94-9c94-452c-8783-df20fbd44f2f tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:32:06.290502 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-a0db4f94-9c94-452c-8783-df20fbd44f2f tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:32:06.290938 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-a0db4f94-9c94-452c-8783-df20fbd44f2f tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:32:06.291622 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-a0db4f94-9c94-452c-8783-df20fbd44f2f tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:32:06.292075 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-a0db4f94-9c94-452c-8783-df20fbd44f2f tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:32:06.292500 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-a0db4f94-9c94-452c-8783-df20fbd44f2f tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:32:06.320408 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-a0db4f94-9c94-452c-8783-df20fbd44f2f tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] 10.222.0.16 "GET /compute/v2.1/servers/3cfc4366-d729-4c23-a899-d259f3afb325/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043861 Oct 31 19:32:06.320942 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 524/1051] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Oct 31 19:32:06 2022] GET /compute/v2.1/servers/3cfc4366-d729-4c23-a899-d259f3afb325/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 19:32:06.382683 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-96c01474-aa70-455c-98ee-46d736c1a748 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:32:06.383166 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-96c01474-aa70-455c-98ee-46d736c1a748 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] [instance: 3cfc4366-d729-4c23-a899-d259f3afb325] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:32:06.390204 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-96c01474-aa70-455c-98ee-46d736c1a748 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:32:06.390691 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-96c01474-aa70-455c-98ee-46d736c1a748 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:32:06.391129 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-96c01474-aa70-455c-98ee-46d736c1a748 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:32:06.391815 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-96c01474-aa70-455c-98ee-46d736c1a748 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:32:06.392267 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-96c01474-aa70-455c-98ee-46d736c1a748 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:32:06.392694 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-96c01474-aa70-455c-98ee-46d736c1a748 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:32:06.417274 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-96c01474-aa70-455c-98ee-46d736c1a748 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] [instance: 3cfc4366-d729-4c23-a899-d259f3afb325] Going to try to terminate instance {{(pid=118726) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 19:32:06.491581 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-96c01474-aa70-455c-98ee-46d736c1a748 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] 10.222.0.16 "DELETE /compute/v2.1/servers/3cfc4366-d729-4c23-a899-d259f3afb325" status: 204 len: 0 microversion: 2.1 time: 0.112392 Oct 31 19:32:06.492253 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 528/1052] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 31 19:32:06 2022] DELETE /compute/v2.1/servers/3cfc4366-d729-4c23-a899-d259f3afb325 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 19:32:06.501682 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-835e3b83-9e1b-4a84-99d5-5048f7f3c6de tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:32:06.502295 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-835e3b83-9e1b-4a84-99d5-5048f7f3c6de tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] [instance: 3cfc4366-d729-4c23-a899-d259f3afb325] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:32:06.508301 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-835e3b83-9e1b-4a84-99d5-5048f7f3c6de tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:32:06.508817 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-835e3b83-9e1b-4a84-99d5-5048f7f3c6de tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:32:06.509283 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-835e3b83-9e1b-4a84-99d5-5048f7f3c6de tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:32:06.510056 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-835e3b83-9e1b-4a84-99d5-5048f7f3c6de tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:32:06.510599 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-835e3b83-9e1b-4a84-99d5-5048f7f3c6de tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:32:06.511075 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-835e3b83-9e1b-4a84-99d5-5048f7f3c6de tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:32:06.639583 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-835e3b83-9e1b-4a84-99d5-5048f7f3c6de tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16778b0dd21d41eeaa6087b67931eef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba9bc456234ea6ade63d41a1624967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:32:06.647335 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-835e3b83-9e1b-4a84-99d5-5048f7f3c6de tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] 10.222.0.16 "GET /compute/v2.1/servers/3cfc4366-d729-4c23-a899-d259f3afb325" status: 200 len: 1680 microversion: 2.1 time: 0.149493 Oct 31 19:32:06.647913 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 525/1053] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:32:06 2022] GET /compute/v2.1/servers/3cfc4366-d729-4c23-a899-d259f3afb325 => generated 1680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 19:32:07.672337 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-84f8268f-c216-4f8c-94d7-266c4298928c tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:32:07.673084 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-84f8268f-c216-4f8c-94d7-266c4298928c tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] [instance: 3cfc4366-d729-4c23-a899-d259f3afb325] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:32:07.679449 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-84f8268f-c216-4f8c-94d7-266c4298928c tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:32:07.679934 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-84f8268f-c216-4f8c-94d7-266c4298928c tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:32:07.680373 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-84f8268f-c216-4f8c-94d7-266c4298928c tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:32:07.681078 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-84f8268f-c216-4f8c-94d7-266c4298928c tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:32:07.681534 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-84f8268f-c216-4f8c-94d7-266c4298928c tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:32:07.681991 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-84f8268f-c216-4f8c-94d7-266c4298928c tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:32:07.809599 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-84f8268f-c216-4f8c-94d7-266c4298928c tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16778b0dd21d41eeaa6087b67931eef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba9bc456234ea6ade63d41a1624967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:32:07.817192 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-84f8268f-c216-4f8c-94d7-266c4298928c tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] 10.222.0.16 "GET /compute/v2.1/servers/3cfc4366-d729-4c23-a899-d259f3afb325" status: 200 len: 1680 microversion: 2.1 time: 0.149386 Oct 31 19:32:07.817780 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 529/1054] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:32:07 2022] GET /compute/v2.1/servers/3cfc4366-d729-4c23-a899-d259f3afb325 => generated 1680 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:32:08.772393 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [req-20db7b3b-d94b-4649-9c18-1943940b252f req-d85e1dd3-1818-4045-a4c0-2e634dd12c77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cfc4366-d729-4c23-a899-d259f3afb325", "name": "network-vif-deleted", "tag": "e5d1bcff-7800-4dd2-a9d0-e0dc8c39ca9e"}]} {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:32:08.787472 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [req-20db7b3b-d94b-4649-9c18-1943940b252f req-d85e1dd3-1818-4045-a4c0-2e634dd12c77 service nova] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:32:08.788564 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [req-20db7b3b-d94b-4649-9c18-1943940b252f req-d85e1dd3-1818-4045-a4c0-2e634dd12c77 service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:32:08.789159 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [req-20db7b3b-d94b-4649-9c18-1943940b252f req-d85e1dd3-1818-4045-a4c0-2e634dd12c77 service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:32:08.802047 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.compute.server_external_events [req-20db7b3b-d94b-4649-9c18-1943940b252f req-d85e1dd3-1818-4045-a4c0-2e634dd12c77 service nova] Creating event network-vif-deleted:e5d1bcff-7800-4dd2-a9d0-e0dc8c39ca9e for instance 3cfc4366-d729-4c23-a899-d259f3afb325 on hv-cinder-86309 Oct 31 19:32:08.807854 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [req-20db7b3b-d94b-4649-9c18-1943940b252f req-d85e1dd3-1818-4045-a4c0-2e634dd12c77 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039235 Oct 31 19:32:08.808759 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 526/1055] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 31 19:32:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:32:08.842613 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-5f98af7c-74be-4ce5-8e96-7a7d5baa2652 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:32:08.843774 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-5f98af7c-74be-4ce5-8e96-7a7d5baa2652 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] [instance: 3cfc4366-d729-4c23-a899-d259f3afb325] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:32:08.852672 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-5f98af7c-74be-4ce5-8e96-7a7d5baa2652 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:32:08.853171 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-5f98af7c-74be-4ce5-8e96-7a7d5baa2652 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:32:08.853649 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-5f98af7c-74be-4ce5-8e96-7a7d5baa2652 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:32:08.854596 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-5f98af7c-74be-4ce5-8e96-7a7d5baa2652 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:32:08.855060 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-5f98af7c-74be-4ce5-8e96-7a7d5baa2652 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:32:08.855489 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-5f98af7c-74be-4ce5-8e96-7a7d5baa2652 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:32:08.944936 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-5f98af7c-74be-4ce5-8e96-7a7d5baa2652 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16778b0dd21d41eeaa6087b67931eef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba9bc456234ea6ade63d41a1624967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:32:08.960400 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-5f98af7c-74be-4ce5-8e96-7a7d5baa2652 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] 10.222.0.16 "GET /compute/v2.1/servers/3cfc4366-d729-4c23-a899-d259f3afb325" status: 200 len: 1325 microversion: 2.1 time: 0.123670 Oct 31 19:32:08.961443 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 530/1056] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:32:08 2022] GET /compute/v2.1/servers/3cfc4366-d729-4c23-a899-d259f3afb325 => generated 1325 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:32:09.985741 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-b7a442fc-05c6-496e-b96a-2014a4ec4566 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:32:09.986457 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-b7a442fc-05c6-496e-b96a-2014a4ec4566 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] [instance: 3cfc4366-d729-4c23-a899-d259f3afb325] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:32:09.993027 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-b7a442fc-05c6-496e-b96a-2014a4ec4566 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:32:09.993457 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-b7a442fc-05c6-496e-b96a-2014a4ec4566 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:32:09.993921 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-b7a442fc-05c6-496e-b96a-2014a4ec4566 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:32:09.994612 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-b7a442fc-05c6-496e-b96a-2014a4ec4566 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:32:09.995068 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-b7a442fc-05c6-496e-b96a-2014a4ec4566 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:32:09.995494 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-b7a442fc-05c6-496e-b96a-2014a4ec4566 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:32:10.008432 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.wsgi [None req-b7a442fc-05c6-496e-b96a-2014a4ec4566 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] HTTP exception thrown: Instance 3cfc4366-d729-4c23-a899-d259f3afb325 could not be found. Oct 31 19:32:10.010075 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-b7a442fc-05c6-496e-b96a-2014a4ec4566 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Request method failure captured: Oct 31 19:32:10.010075 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: request: GET /compute/v2.1/servers/3cfc4366-d729-4c23-a899-d259f3afb325 HTTP/1.1 Oct 31 19:32:10.010075 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Accept: application/json Oct 31 19:32:10.010075 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Accept-Encoding: identity Oct 31 19:32:10.010075 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Connection: close Oct 31 19:32:10.010075 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Content-Length: 0 Oct 31 19:32:10.010075 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Content-Type: application/json Oct 31 19:32:10.010075 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Host: 10.222.0.16 Oct 31 19:32:10.010075 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Openstack-System-Scope: None Oct 31 19:32:10.010075 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: User-Agent: python-urllib3/1.26.12 Oct 31 19:32:10.010075 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Auth-Token: gAAAAABjYCG5aDHxCXWKl54hrIP8uylj79sP0BDeZd_ckOPD9KTXbM2ReEx2xP85m13HtVq0_y1CIML9YTOWHjoWbtPsbViKMinP0f-u0wr8bnwCjlILH4aKfybx_z4WSYI8NEE_nzlMlhmG0HnRtdfd3ZDvw9RFGweGeDxD4VM0dXtgMk2CUO4 Oct 31 19:32:10.010075 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Domain-Id: None Oct 31 19:32:10.010075 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Domain-Name: None Oct 31 19:32:10.010075 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Identity-Status: Confirmed Oct 31 19:32:10.010075 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Is-Admin-Project: True Oct 31 19:32:10.010075 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Project-Domain-Id: default Oct 31 19:32:10.010075 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Project-Domain-Name: Default Oct 31 19:32:10.010075 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Project-Id: adba9bc456234ea6ade63d41a1624967 Oct 31 19:32:10.010075 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Project-Name: tempest-AttachVolumeNegativeTest-1656947587 Oct 31 19:32:10.010075 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Role: member,reader Oct 31 19:32:10.010075 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Roles: member,reader Oct 31 19:32:10.011770 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/adba9bc456234ea6ade63d41a1624967"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_adba9bc456234ea6ade63d41a1624967", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/adba9bc456234ea6ade63d41a1624967"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/adba9bc456234ea6ade63d41a1624967"}]}] Oct 31 19:32:10.011770 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Tenant: tempest-AttachVolumeNegativeTest-1656947587 Oct 31 19:32:10.011770 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Tenant-Id: adba9bc456234ea6ade63d41a1624967 Oct 31 19:32:10.011770 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1656947587 Oct 31 19:32:10.011770 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User: tempest-AttachVolumeNegativeTest-1656947587-project Oct 31 19:32:10.011770 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User-Domain-Id: default Oct 31 19:32:10.011770 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User-Domain-Name: Default Oct 31 19:32:10.011770 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User-Id: 16778b0dd21d41eeaa6087b67931eef8 Oct 31 19:32:10.011770 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User-Name: tempest-AttachVolumeNegativeTest-1656947587-project Oct 31 19:32:10.011770 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: method: > Oct 31 19:32:10.011770 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: exception: Instance 3cfc4366-d729-4c23-a899-d259f3afb325 could not be found. Oct 31 19:32:10.011770 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: action_args: {'id': '3cfc4366-d729-4c23-a899-d259f3afb325'} Oct 31 19:32:10.012800 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 19:32:10.012800 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:32:10.012800 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 19:32:10.012800 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 19:32:10.012800 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 19:32:10.012800 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 19:32:10.012800 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 19:32:10.012800 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 19:32:10.012800 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 19:32:10.012800 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 19:32:10.012800 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3cfc4366-d729-4c23-a899-d259f3afb325 could not be found. Oct 31 19:32:10.012800 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:32:10.012800 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 19:32:10.012800 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:32:10.012800 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:32:10.012800 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 19:32:10.012800 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 19:32:10.012800 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 19:32:10.012800 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 19:32:10.012800 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 19:32:10.014458 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 19:32:10.014458 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 19:32:10.014458 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 19:32:10.014458 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 19:32:10.014458 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 19:32:10.014458 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 19:32:10.014458 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 19:32:10.014458 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3cfc4366-d729-4c23-a899-d259f3afb325 could not be found. Oct 31 19:32:10.014458 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:32:10.014458 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 19:32:10.014458 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:32:10.014458 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:32:10.014458 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 19:32:10.014458 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 19:32:10.014458 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 19:32:10.014458 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 19:32:10.014458 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3cfc4366-d729-4c23-a899-d259f3afb325 could not be found. Oct 31 19:32:10.014458 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:32:10.015875 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-b7a442fc-05c6-496e-b96a-2014a4ec4566 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Returning 404 to user: Instance 3cfc4366-d729-4c23-a899-d259f3afb325 could not be found. {{(pid=118727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 19:32:10.015875 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-b7a442fc-05c6-496e-b96a-2014a4ec4566 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] 10.222.0.16 "GET /compute/v2.1/servers/3cfc4366-d729-4c23-a899-d259f3afb325" status: 404 len: 111 microversion: 2.1 time: 0.030612 Oct 31 19:32:10.015875 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 527/1057] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:32:09 2022] GET /compute/v2.1/servers/3cfc4366-d729-4c23-a899-d259f3afb325 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 19:32:10.020139 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-8ed38968-843b-42b8-84a4-f9d263c31d62 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Calling method '.version_select at 0x7f34f1df6af0>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:32:10.038818 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-8ed38968-843b-42b8-84a4-f9d263c31d62 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-145842299" status: 202 len: 0 microversion: 2.1 time: 0.022223 Oct 31 19:32:10.039403 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 531/1058] 10.222.0.16 () {58 vars in 1218 bytes} [Mon Oct 31 19:32:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-145842299 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 19:32:11.760533 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-03c445b4-a17a-48eb-8c33-6130609de233 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:32:11.761016 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-03c445b4-a17a-48eb-8c33-6130609de233 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] [instance: 3cfc4366-d729-4c23-a899-d259f3afb325] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:32:11.767836 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-03c445b4-a17a-48eb-8c33-6130609de233 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:32:11.768314 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-03c445b4-a17a-48eb-8c33-6130609de233 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:32:11.768748 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-03c445b4-a17a-48eb-8c33-6130609de233 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:32:11.769429 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-03c445b4-a17a-48eb-8c33-6130609de233 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:32:11.769919 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-03c445b4-a17a-48eb-8c33-6130609de233 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:32:11.770342 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-03c445b4-a17a-48eb-8c33-6130609de233 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:32:11.784276 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.wsgi [None req-03c445b4-a17a-48eb-8c33-6130609de233 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] HTTP exception thrown: Instance 3cfc4366-d729-4c23-a899-d259f3afb325 could not be found. Oct 31 19:32:11.785850 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-03c445b4-a17a-48eb-8c33-6130609de233 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Request method failure captured: Oct 31 19:32:11.785850 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: request: DELETE /compute/v2.1/servers/3cfc4366-d729-4c23-a899-d259f3afb325 HTTP/1.1 Oct 31 19:32:11.785850 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Accept: application/json Oct 31 19:32:11.785850 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Accept-Encoding: identity Oct 31 19:32:11.785850 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Connection: close Oct 31 19:32:11.785850 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Content-Length: 0 Oct 31 19:32:11.785850 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Content-Type: application/json Oct 31 19:32:11.785850 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Host: 10.222.0.16 Oct 31 19:32:11.785850 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Openstack-System-Scope: None Oct 31 19:32:11.785850 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: User-Agent: python-urllib3/1.26.12 Oct 31 19:32:11.785850 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Auth-Token: gAAAAABjYCG5aDHxCXWKl54hrIP8uylj79sP0BDeZd_ckOPD9KTXbM2ReEx2xP85m13HtVq0_y1CIML9YTOWHjoWbtPsbViKMinP0f-u0wr8bnwCjlILH4aKfybx_z4WSYI8NEE_nzlMlhmG0HnRtdfd3ZDvw9RFGweGeDxD4VM0dXtgMk2CUO4 Oct 31 19:32:11.785850 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Domain-Id: None Oct 31 19:32:11.785850 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Domain-Name: None Oct 31 19:32:11.785850 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Identity-Status: Confirmed Oct 31 19:32:11.785850 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Is-Admin-Project: True Oct 31 19:32:11.785850 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Project-Domain-Id: default Oct 31 19:32:11.785850 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Project-Domain-Name: Default Oct 31 19:32:11.785850 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Project-Id: adba9bc456234ea6ade63d41a1624967 Oct 31 19:32:11.785850 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Project-Name: tempest-AttachVolumeNegativeTest-1656947587 Oct 31 19:32:11.785850 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Role: member,reader Oct 31 19:32:11.785850 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Roles: member,reader Oct 31 19:32:11.787468 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/adba9bc456234ea6ade63d41a1624967"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_adba9bc456234ea6ade63d41a1624967", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/adba9bc456234ea6ade63d41a1624967"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/adba9bc456234ea6ade63d41a1624967"}]}] Oct 31 19:32:11.787468 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Tenant: tempest-AttachVolumeNegativeTest-1656947587 Oct 31 19:32:11.787468 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Tenant-Id: adba9bc456234ea6ade63d41a1624967 Oct 31 19:32:11.787468 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1656947587 Oct 31 19:32:11.787468 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User: tempest-AttachVolumeNegativeTest-1656947587-project Oct 31 19:32:11.787468 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User-Domain-Id: default Oct 31 19:32:11.787468 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User-Domain-Name: Default Oct 31 19:32:11.787468 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User-Id: 16778b0dd21d41eeaa6087b67931eef8 Oct 31 19:32:11.787468 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User-Name: tempest-AttachVolumeNegativeTest-1656947587-project Oct 31 19:32:11.787468 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: method: > Oct 31 19:32:11.787468 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: exception: Instance 3cfc4366-d729-4c23-a899-d259f3afb325 could not be found. Oct 31 19:32:11.787468 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: action_args: {'id': '3cfc4366-d729-4c23-a899-d259f3afb325'} Oct 31 19:32:11.788829 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 19:32:11.788829 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:32:11.788829 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 19:32:11.788829 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 19:32:11.788829 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 19:32:11.788829 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 19:32:11.788829 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 19:32:11.788829 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 19:32:11.788829 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 19:32:11.788829 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 19:32:11.788829 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3cfc4366-d729-4c23-a899-d259f3afb325 could not be found. Oct 31 19:32:11.788829 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:32:11.788829 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 19:32:11.788829 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:32:11.788829 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:32:11.788829 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 19:32:11.788829 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 19:32:11.788829 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 19:32:11.788829 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 19:32:11.788829 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 19:32:11.790366 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 19:32:11.790366 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 19:32:11.790366 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 19:32:11.790366 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 19:32:11.790366 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 19:32:11.790366 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 19:32:11.790366 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 19:32:11.790366 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 19:32:11.790366 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 19:32:11.790366 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3cfc4366-d729-4c23-a899-d259f3afb325 could not be found. Oct 31 19:32:11.790366 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:32:11.790366 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 19:32:11.790366 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:32:11.790366 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:32:11.790366 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 19:32:11.790366 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 19:32:11.790366 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 19:32:11.790366 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 19:32:11.790366 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3cfc4366-d729-4c23-a899-d259f3afb325 could not be found. Oct 31 19:32:11.790366 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:32:11.792122 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-03c445b4-a17a-48eb-8c33-6130609de233 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Returning 404 to user: Instance 3cfc4366-d729-4c23-a899-d259f3afb325 could not be found. {{(pid=118727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 19:32:11.792122 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-03c445b4-a17a-48eb-8c33-6130609de233 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] 10.222.0.16 "DELETE /compute/v2.1/servers/3cfc4366-d729-4c23-a899-d259f3afb325" status: 404 len: 111 microversion: 2.1 time: 0.030592 Oct 31 19:32:11.792122 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 528/1059] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 31 19:32:11 2022] DELETE /compute/v2.1/servers/3cfc4366-d729-4c23-a899-d259f3afb325 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 19:32:11.796482 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-5fc441c4-fe7a-49e1-83d1-9c9db576c3ee tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:32:11.797085 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-5fc441c4-fe7a-49e1-83d1-9c9db576c3ee tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] [instance: 3cfc4366-d729-4c23-a899-d259f3afb325] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:32:11.803685 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-5fc441c4-fe7a-49e1-83d1-9c9db576c3ee tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:32:11.804159 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-5fc441c4-fe7a-49e1-83d1-9c9db576c3ee tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:32:11.804587 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-5fc441c4-fe7a-49e1-83d1-9c9db576c3ee tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:32:11.805264 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-5fc441c4-fe7a-49e1-83d1-9c9db576c3ee tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:32:11.805742 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-5fc441c4-fe7a-49e1-83d1-9c9db576c3ee tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:32:11.806166 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-5fc441c4-fe7a-49e1-83d1-9c9db576c3ee tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:32:11.818827 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.wsgi [None req-5fc441c4-fe7a-49e1-83d1-9c9db576c3ee tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] HTTP exception thrown: Instance 3cfc4366-d729-4c23-a899-d259f3afb325 could not be found. Oct 31 19:32:11.820441 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-5fc441c4-fe7a-49e1-83d1-9c9db576c3ee tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Request method failure captured: Oct 31 19:32:11.820441 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: request: GET /compute/v2.1/servers/3cfc4366-d729-4c23-a899-d259f3afb325 HTTP/1.1 Oct 31 19:32:11.820441 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: Accept: application/json Oct 31 19:32:11.820441 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: Accept-Encoding: identity Oct 31 19:32:11.820441 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: Connection: close Oct 31 19:32:11.820441 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: Content-Length: 0 Oct 31 19:32:11.820441 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: Content-Type: application/json Oct 31 19:32:11.820441 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: Host: 10.222.0.16 Oct 31 19:32:11.820441 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: Openstack-System-Scope: None Oct 31 19:32:11.820441 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: User-Agent: python-urllib3/1.26.12 Oct 31 19:32:11.820441 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Auth-Token: gAAAAABjYCG5aDHxCXWKl54hrIP8uylj79sP0BDeZd_ckOPD9KTXbM2ReEx2xP85m13HtVq0_y1CIML9YTOWHjoWbtPsbViKMinP0f-u0wr8bnwCjlILH4aKfybx_z4WSYI8NEE_nzlMlhmG0HnRtdfd3ZDvw9RFGweGeDxD4VM0dXtgMk2CUO4 Oct 31 19:32:11.820441 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Domain-Id: None Oct 31 19:32:11.820441 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Domain-Name: None Oct 31 19:32:11.820441 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Identity-Status: Confirmed Oct 31 19:32:11.820441 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Is-Admin-Project: True Oct 31 19:32:11.820441 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Project-Domain-Id: default Oct 31 19:32:11.820441 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Project-Domain-Name: Default Oct 31 19:32:11.820441 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Project-Id: adba9bc456234ea6ade63d41a1624967 Oct 31 19:32:11.820441 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Project-Name: tempest-AttachVolumeNegativeTest-1656947587 Oct 31 19:32:11.820441 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Role: member,reader Oct 31 19:32:11.820441 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Roles: member,reader Oct 31 19:32:11.822153 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/adba9bc456234ea6ade63d41a1624967"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_adba9bc456234ea6ade63d41a1624967", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/adba9bc456234ea6ade63d41a1624967"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/adba9bc456234ea6ade63d41a1624967"}]}] Oct 31 19:32:11.822153 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Tenant: tempest-AttachVolumeNegativeTest-1656947587 Oct 31 19:32:11.822153 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Tenant-Id: adba9bc456234ea6ade63d41a1624967 Oct 31 19:32:11.822153 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1656947587 Oct 31 19:32:11.822153 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-User: tempest-AttachVolumeNegativeTest-1656947587-project Oct 31 19:32:11.822153 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-User-Domain-Id: default Oct 31 19:32:11.822153 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-User-Domain-Name: Default Oct 31 19:32:11.822153 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-User-Id: 16778b0dd21d41eeaa6087b67931eef8 Oct 31 19:32:11.822153 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-User-Name: tempest-AttachVolumeNegativeTest-1656947587-project Oct 31 19:32:11.822153 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: method: > Oct 31 19:32:11.822153 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: exception: Instance 3cfc4366-d729-4c23-a899-d259f3afb325 could not be found. Oct 31 19:32:11.822153 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: action_args: {'id': '3cfc4366-d729-4c23-a899-d259f3afb325'} Oct 31 19:32:11.823295 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 19:32:11.823295 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:32:11.823295 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 19:32:11.823295 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 19:32:11.823295 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 19:32:11.823295 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 19:32:11.823295 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 19:32:11.823295 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 19:32:11.823295 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 19:32:11.823295 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 19:32:11.823295 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3cfc4366-d729-4c23-a899-d259f3afb325 could not be found. Oct 31 19:32:11.823295 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Oct 31 19:32:11.823295 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 19:32:11.823295 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Oct 31 19:32:11.823295 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:32:11.823295 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 19:32:11.823295 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 19:32:11.823295 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 19:32:11.823295 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 19:32:11.823295 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 19:32:11.825432 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 19:32:11.825432 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 19:32:11.825432 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 19:32:11.825432 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 19:32:11.825432 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 19:32:11.825432 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 19:32:11.825432 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 19:32:11.825432 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3cfc4366-d729-4c23-a899-d259f3afb325 could not be found. Oct 31 19:32:11.825432 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Oct 31 19:32:11.825432 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 19:32:11.825432 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Oct 31 19:32:11.825432 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:32:11.825432 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 19:32:11.825432 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 19:32:11.825432 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 19:32:11.825432 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 19:32:11.825432 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3cfc4366-d729-4c23-a899-d259f3afb325 could not be found. Oct 31 19:32:11.825432 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Oct 31 19:32:11.826990 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-5fc441c4-fe7a-49e1-83d1-9c9db576c3ee tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Returning 404 to user: Instance 3cfc4366-d729-4c23-a899-d259f3afb325 could not be found. {{(pid=118726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 19:32:11.826990 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-5fc441c4-fe7a-49e1-83d1-9c9db576c3ee tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] 10.222.0.16 "GET /compute/v2.1/servers/3cfc4366-d729-4c23-a899-d259f3afb325" status: 404 len: 111 microversion: 2.1 time: 0.029680 Oct 31 19:32:11.826990 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 532/1060] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:32:11 2022] GET /compute/v2.1/servers/3cfc4366-d729-4c23-a899-d259f3afb325 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 19:32:12.961150 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-52315618-01df-4bf8-89ef-4add3d96556c tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:32:12.961669 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-52315618-01df-4bf8-89ef-4add3d96556c tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] [instance: 0fc7bec3-39c9-4048-a84e-914159181e7d] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:32:12.968059 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-52315618-01df-4bf8-89ef-4add3d96556c tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:32:12.968530 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-52315618-01df-4bf8-89ef-4add3d96556c tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:32:12.968957 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-52315618-01df-4bf8-89ef-4add3d96556c tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:32:12.969661 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-52315618-01df-4bf8-89ef-4add3d96556c tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:32:12.970115 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-52315618-01df-4bf8-89ef-4add3d96556c tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:32:12.970538 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-52315618-01df-4bf8-89ef-4add3d96556c tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:32:12.983534 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.wsgi [None req-52315618-01df-4bf8-89ef-4add3d96556c tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] HTTP exception thrown: Instance 0fc7bec3-39c9-4048-a84e-914159181e7d could not be found. Oct 31 19:32:12.985046 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-52315618-01df-4bf8-89ef-4add3d96556c tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Request method failure captured: Oct 31 19:32:12.985046 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: request: DELETE /compute/v2.1/servers/0fc7bec3-39c9-4048-a84e-914159181e7d HTTP/1.1 Oct 31 19:32:12.985046 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Accept: application/json Oct 31 19:32:12.985046 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Accept-Encoding: identity Oct 31 19:32:12.985046 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Connection: close Oct 31 19:32:12.985046 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Content-Length: 0 Oct 31 19:32:12.985046 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Content-Type: application/json Oct 31 19:32:12.985046 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Host: 10.222.0.16 Oct 31 19:32:12.985046 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Openstack-System-Scope: None Oct 31 19:32:12.985046 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: User-Agent: python-urllib3/1.26.12 Oct 31 19:32:12.985046 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Auth-Token: gAAAAABjYCG5aDHxCXWKl54hrIP8uylj79sP0BDeZd_ckOPD9KTXbM2ReEx2xP85m13HtVq0_y1CIML9YTOWHjoWbtPsbViKMinP0f-u0wr8bnwCjlILH4aKfybx_z4WSYI8NEE_nzlMlhmG0HnRtdfd3ZDvw9RFGweGeDxD4VM0dXtgMk2CUO4 Oct 31 19:32:12.985046 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Domain-Id: None Oct 31 19:32:12.985046 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Domain-Name: None Oct 31 19:32:12.985046 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Identity-Status: Confirmed Oct 31 19:32:12.985046 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Is-Admin-Project: True Oct 31 19:32:12.985046 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Project-Domain-Id: default Oct 31 19:32:12.985046 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Project-Domain-Name: Default Oct 31 19:32:12.985046 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Project-Id: adba9bc456234ea6ade63d41a1624967 Oct 31 19:32:12.985046 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Project-Name: tempest-AttachVolumeNegativeTest-1656947587 Oct 31 19:32:12.985046 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Role: member,reader Oct 31 19:32:12.985046 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Roles: member,reader Oct 31 19:32:12.986690 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/adba9bc456234ea6ade63d41a1624967"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_adba9bc456234ea6ade63d41a1624967", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/adba9bc456234ea6ade63d41a1624967"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/adba9bc456234ea6ade63d41a1624967"}]}] Oct 31 19:32:12.986690 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Tenant: tempest-AttachVolumeNegativeTest-1656947587 Oct 31 19:32:12.986690 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Tenant-Id: adba9bc456234ea6ade63d41a1624967 Oct 31 19:32:12.986690 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1656947587 Oct 31 19:32:12.986690 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User: tempest-AttachVolumeNegativeTest-1656947587-project Oct 31 19:32:12.986690 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User-Domain-Id: default Oct 31 19:32:12.986690 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User-Domain-Name: Default Oct 31 19:32:12.986690 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User-Id: 16778b0dd21d41eeaa6087b67931eef8 Oct 31 19:32:12.986690 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User-Name: tempest-AttachVolumeNegativeTest-1656947587-project Oct 31 19:32:12.986690 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: method: > Oct 31 19:32:12.986690 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: exception: Instance 0fc7bec3-39c9-4048-a84e-914159181e7d could not be found. Oct 31 19:32:12.986690 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: action_args: {'id': '0fc7bec3-39c9-4048-a84e-914159181e7d'} Oct 31 19:32:12.987764 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 19:32:12.987764 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:32:12.987764 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 19:32:12.987764 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 19:32:12.987764 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 19:32:12.987764 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 19:32:12.987764 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 19:32:12.987764 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 19:32:12.987764 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 19:32:12.987764 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 19:32:12.987764 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0fc7bec3-39c9-4048-a84e-914159181e7d could not be found. Oct 31 19:32:12.987764 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:32:12.987764 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 19:32:12.987764 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:32:12.987764 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:32:12.987764 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 19:32:12.987764 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 19:32:12.987764 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 19:32:12.987764 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 19:32:12.987764 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 19:32:12.989257 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 19:32:12.989257 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 19:32:12.989257 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 19:32:12.989257 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 19:32:12.989257 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 19:32:12.989257 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 19:32:12.989257 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 19:32:12.989257 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 19:32:12.989257 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 19:32:12.989257 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0fc7bec3-39c9-4048-a84e-914159181e7d could not be found. Oct 31 19:32:12.989257 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:32:12.989257 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 19:32:12.989257 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:32:12.989257 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:32:12.989257 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 19:32:12.989257 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 19:32:12.989257 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 19:32:12.989257 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 19:32:12.989257 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0fc7bec3-39c9-4048-a84e-914159181e7d could not be found. Oct 31 19:32:12.989257 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:32:12.990890 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-52315618-01df-4bf8-89ef-4add3d96556c tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Returning 404 to user: Instance 0fc7bec3-39c9-4048-a84e-914159181e7d could not be found. {{(pid=118727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 19:32:12.990890 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-52315618-01df-4bf8-89ef-4add3d96556c tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] 10.222.0.16 "DELETE /compute/v2.1/servers/0fc7bec3-39c9-4048-a84e-914159181e7d" status: 404 len: 111 microversion: 2.1 time: 0.029175 Oct 31 19:32:12.990890 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 529/1061] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 31 19:32:12 2022] DELETE /compute/v2.1/servers/0fc7bec3-39c9-4048-a84e-914159181e7d => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 19:32:12.996101 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-7823a660-25b5-434d-b17d-8d27fa4f49fa tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:32:12.997199 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-7823a660-25b5-434d-b17d-8d27fa4f49fa tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] [instance: 0fc7bec3-39c9-4048-a84e-914159181e7d] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:32:13.003449 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-7823a660-25b5-434d-b17d-8d27fa4f49fa tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:32:13.003924 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-7823a660-25b5-434d-b17d-8d27fa4f49fa tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:32:13.004350 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-7823a660-25b5-434d-b17d-8d27fa4f49fa tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:32:13.005035 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-7823a660-25b5-434d-b17d-8d27fa4f49fa tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:32:13.005483 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-7823a660-25b5-434d-b17d-8d27fa4f49fa tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:32:13.005925 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-7823a660-25b5-434d-b17d-8d27fa4f49fa tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:32:13.019566 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.wsgi [None req-7823a660-25b5-434d-b17d-8d27fa4f49fa tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] HTTP exception thrown: Instance 0fc7bec3-39c9-4048-a84e-914159181e7d could not be found. Oct 31 19:32:13.021050 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-7823a660-25b5-434d-b17d-8d27fa4f49fa tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Request method failure captured: Oct 31 19:32:13.021050 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: request: GET /compute/v2.1/servers/0fc7bec3-39c9-4048-a84e-914159181e7d HTTP/1.1 Oct 31 19:32:13.021050 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: Accept: application/json Oct 31 19:32:13.021050 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: Accept-Encoding: identity Oct 31 19:32:13.021050 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: Connection: close Oct 31 19:32:13.021050 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: Content-Length: 0 Oct 31 19:32:13.021050 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: Content-Type: application/json Oct 31 19:32:13.021050 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: Host: 10.222.0.16 Oct 31 19:32:13.021050 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: Openstack-System-Scope: None Oct 31 19:32:13.021050 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: User-Agent: python-urllib3/1.26.12 Oct 31 19:32:13.021050 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Auth-Token: gAAAAABjYCG5aDHxCXWKl54hrIP8uylj79sP0BDeZd_ckOPD9KTXbM2ReEx2xP85m13HtVq0_y1CIML9YTOWHjoWbtPsbViKMinP0f-u0wr8bnwCjlILH4aKfybx_z4WSYI8NEE_nzlMlhmG0HnRtdfd3ZDvw9RFGweGeDxD4VM0dXtgMk2CUO4 Oct 31 19:32:13.021050 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Domain-Id: None Oct 31 19:32:13.021050 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Domain-Name: None Oct 31 19:32:13.021050 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Identity-Status: Confirmed Oct 31 19:32:13.021050 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Is-Admin-Project: True Oct 31 19:32:13.021050 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Project-Domain-Id: default Oct 31 19:32:13.021050 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Project-Domain-Name: Default Oct 31 19:32:13.021050 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Project-Id: adba9bc456234ea6ade63d41a1624967 Oct 31 19:32:13.021050 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Project-Name: tempest-AttachVolumeNegativeTest-1656947587 Oct 31 19:32:13.021050 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Role: member,reader Oct 31 19:32:13.021050 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Roles: member,reader Oct 31 19:32:13.022799 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/adba9bc456234ea6ade63d41a1624967"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_adba9bc456234ea6ade63d41a1624967", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/adba9bc456234ea6ade63d41a1624967"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/adba9bc456234ea6ade63d41a1624967"}]}] Oct 31 19:32:13.022799 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Tenant: tempest-AttachVolumeNegativeTest-1656947587 Oct 31 19:32:13.022799 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Tenant-Id: adba9bc456234ea6ade63d41a1624967 Oct 31 19:32:13.022799 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1656947587 Oct 31 19:32:13.022799 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-User: tempest-AttachVolumeNegativeTest-1656947587-project Oct 31 19:32:13.022799 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-User-Domain-Id: default Oct 31 19:32:13.022799 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-User-Domain-Name: Default Oct 31 19:32:13.022799 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-User-Id: 16778b0dd21d41eeaa6087b67931eef8 Oct 31 19:32:13.022799 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-User-Name: tempest-AttachVolumeNegativeTest-1656947587-project Oct 31 19:32:13.022799 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: method: > Oct 31 19:32:13.022799 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: exception: Instance 0fc7bec3-39c9-4048-a84e-914159181e7d could not be found. Oct 31 19:32:13.022799 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: action_args: {'id': '0fc7bec3-39c9-4048-a84e-914159181e7d'} Oct 31 19:32:13.023884 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 19:32:13.023884 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:32:13.023884 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 19:32:13.023884 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 19:32:13.023884 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 19:32:13.023884 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 19:32:13.023884 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 19:32:13.023884 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 19:32:13.023884 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 19:32:13.023884 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 19:32:13.023884 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0fc7bec3-39c9-4048-a84e-914159181e7d could not be found. Oct 31 19:32:13.023884 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Oct 31 19:32:13.023884 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 19:32:13.023884 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Oct 31 19:32:13.023884 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:32:13.023884 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 19:32:13.023884 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 19:32:13.023884 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 19:32:13.023884 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 19:32:13.023884 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 19:32:13.025358 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 19:32:13.025358 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 19:32:13.025358 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 19:32:13.025358 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 19:32:13.025358 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 19:32:13.025358 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 19:32:13.025358 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 19:32:13.025358 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0fc7bec3-39c9-4048-a84e-914159181e7d could not be found. Oct 31 19:32:13.025358 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Oct 31 19:32:13.025358 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 19:32:13.025358 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Oct 31 19:32:13.025358 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:32:13.025358 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 19:32:13.025358 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 19:32:13.025358 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 19:32:13.025358 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 19:32:13.025358 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0fc7bec3-39c9-4048-a84e-914159181e7d could not be found. Oct 31 19:32:13.025358 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Oct 31 19:32:13.026757 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-7823a660-25b5-434d-b17d-8d27fa4f49fa tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Returning 404 to user: Instance 0fc7bec3-39c9-4048-a84e-914159181e7d could not be found. {{(pid=118726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 19:32:13.026757 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-7823a660-25b5-434d-b17d-8d27fa4f49fa tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] 10.222.0.16 "GET /compute/v2.1/servers/0fc7bec3-39c9-4048-a84e-914159181e7d" status: 404 len: 111 microversion: 2.1 time: 0.030210 Oct 31 19:32:13.026757 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 533/1062] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:32:12 2022] GET /compute/v2.1/servers/0fc7bec3-39c9-4048-a84e-914159181e7d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 19:32:13.030635 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-f63c32ba-dd7c-4f73-8243-eb9df094eada tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:32:13.031129 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-f63c32ba-dd7c-4f73-8243-eb9df094eada tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] [instance: a3be5488-67cf-4a84-ae40-9c0bf189ffd1] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:32:13.036893 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-f63c32ba-dd7c-4f73-8243-eb9df094eada tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:32:13.037372 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-f63c32ba-dd7c-4f73-8243-eb9df094eada tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:32:13.037843 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-f63c32ba-dd7c-4f73-8243-eb9df094eada tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:32:13.038778 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-f63c32ba-dd7c-4f73-8243-eb9df094eada tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:32:13.039231 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-f63c32ba-dd7c-4f73-8243-eb9df094eada tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:32:13.039654 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-f63c32ba-dd7c-4f73-8243-eb9df094eada tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:32:13.052760 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.wsgi [None req-f63c32ba-dd7c-4f73-8243-eb9df094eada tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] HTTP exception thrown: Instance a3be5488-67cf-4a84-ae40-9c0bf189ffd1 could not be found. Oct 31 19:32:13.054240 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-f63c32ba-dd7c-4f73-8243-eb9df094eada tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Request method failure captured: Oct 31 19:32:13.054240 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: request: DELETE /compute/v2.1/servers/a3be5488-67cf-4a84-ae40-9c0bf189ffd1 HTTP/1.1 Oct 31 19:32:13.054240 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Accept: application/json Oct 31 19:32:13.054240 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Accept-Encoding: identity Oct 31 19:32:13.054240 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Connection: close Oct 31 19:32:13.054240 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Content-Length: 0 Oct 31 19:32:13.054240 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Content-Type: application/json Oct 31 19:32:13.054240 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Host: 10.222.0.16 Oct 31 19:32:13.054240 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Openstack-System-Scope: None Oct 31 19:32:13.054240 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: User-Agent: python-urllib3/1.26.12 Oct 31 19:32:13.054240 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Auth-Token: gAAAAABjYCG5aDHxCXWKl54hrIP8uylj79sP0BDeZd_ckOPD9KTXbM2ReEx2xP85m13HtVq0_y1CIML9YTOWHjoWbtPsbViKMinP0f-u0wr8bnwCjlILH4aKfybx_z4WSYI8NEE_nzlMlhmG0HnRtdfd3ZDvw9RFGweGeDxD4VM0dXtgMk2CUO4 Oct 31 19:32:13.054240 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Domain-Id: None Oct 31 19:32:13.054240 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Domain-Name: None Oct 31 19:32:13.054240 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Identity-Status: Confirmed Oct 31 19:32:13.054240 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Is-Admin-Project: True Oct 31 19:32:13.054240 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Project-Domain-Id: default Oct 31 19:32:13.054240 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Project-Domain-Name: Default Oct 31 19:32:13.054240 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Project-Id: adba9bc456234ea6ade63d41a1624967 Oct 31 19:32:13.054240 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Project-Name: tempest-AttachVolumeNegativeTest-1656947587 Oct 31 19:32:13.054240 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Role: member,reader Oct 31 19:32:13.054240 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Roles: member,reader Oct 31 19:32:13.055807 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/adba9bc456234ea6ade63d41a1624967"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_adba9bc456234ea6ade63d41a1624967", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/adba9bc456234ea6ade63d41a1624967"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/adba9bc456234ea6ade63d41a1624967"}]}] Oct 31 19:32:13.055807 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Tenant: tempest-AttachVolumeNegativeTest-1656947587 Oct 31 19:32:13.055807 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Tenant-Id: adba9bc456234ea6ade63d41a1624967 Oct 31 19:32:13.055807 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1656947587 Oct 31 19:32:13.055807 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User: tempest-AttachVolumeNegativeTest-1656947587-project Oct 31 19:32:13.055807 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User-Domain-Id: default Oct 31 19:32:13.055807 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User-Domain-Name: Default Oct 31 19:32:13.055807 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User-Id: 16778b0dd21d41eeaa6087b67931eef8 Oct 31 19:32:13.055807 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User-Name: tempest-AttachVolumeNegativeTest-1656947587-project Oct 31 19:32:13.055807 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: method: > Oct 31 19:32:13.055807 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: exception: Instance a3be5488-67cf-4a84-ae40-9c0bf189ffd1 could not be found. Oct 31 19:32:13.055807 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: action_args: {'id': 'a3be5488-67cf-4a84-ae40-9c0bf189ffd1'} Oct 31 19:32:13.056599 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 19:32:13.056599 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:32:13.056599 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 19:32:13.056599 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 19:32:13.056599 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 19:32:13.056599 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 19:32:13.056599 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 19:32:13.056599 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 19:32:13.056599 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 19:32:13.056599 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 19:32:13.056599 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3be5488-67cf-4a84-ae40-9c0bf189ffd1 could not be found. Oct 31 19:32:13.056599 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:32:13.056599 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 19:32:13.056599 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:32:13.056599 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:32:13.056599 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 19:32:13.056599 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 19:32:13.056599 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 19:32:13.056599 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 19:32:13.056599 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 19:32:13.058103 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 19:32:13.058103 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 19:32:13.058103 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 19:32:13.058103 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 19:32:13.058103 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 19:32:13.058103 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 19:32:13.058103 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 19:32:13.058103 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 19:32:13.058103 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 19:32:13.058103 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3be5488-67cf-4a84-ae40-9c0bf189ffd1 could not be found. Oct 31 19:32:13.058103 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:32:13.058103 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 19:32:13.058103 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:32:13.058103 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:32:13.058103 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 19:32:13.058103 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 19:32:13.058103 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 19:32:13.058103 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 19:32:13.058103 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3be5488-67cf-4a84-ae40-9c0bf189ffd1 could not be found. Oct 31 19:32:13.058103 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:32:13.060282 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-f63c32ba-dd7c-4f73-8243-eb9df094eada tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Returning 404 to user: Instance a3be5488-67cf-4a84-ae40-9c0bf189ffd1 could not be found. {{(pid=118727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 19:32:13.060282 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-f63c32ba-dd7c-4f73-8243-eb9df094eada tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] 10.222.0.16 "DELETE /compute/v2.1/servers/a3be5488-67cf-4a84-ae40-9c0bf189ffd1" status: 404 len: 111 microversion: 2.1 time: 0.028781 Oct 31 19:32:13.060282 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 530/1063] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 31 19:32:13 2022] DELETE /compute/v2.1/servers/a3be5488-67cf-4a84-ae40-9c0bf189ffd1 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 19:32:13.064212 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-bef0dc47-8a42-42a3-a432-703527e4a116 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:32:13.064819 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-bef0dc47-8a42-42a3-a432-703527e4a116 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] [instance: a3be5488-67cf-4a84-ae40-9c0bf189ffd1] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:32:13.070673 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-bef0dc47-8a42-42a3-a432-703527e4a116 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:32:13.071145 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-bef0dc47-8a42-42a3-a432-703527e4a116 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:32:13.071574 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-bef0dc47-8a42-42a3-a432-703527e4a116 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:32:13.072248 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-bef0dc47-8a42-42a3-a432-703527e4a116 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:32:13.072699 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-bef0dc47-8a42-42a3-a432-703527e4a116 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:32:13.073117 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-bef0dc47-8a42-42a3-a432-703527e4a116 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:32:13.088904 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.wsgi [None req-bef0dc47-8a42-42a3-a432-703527e4a116 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] HTTP exception thrown: Instance a3be5488-67cf-4a84-ae40-9c0bf189ffd1 could not be found. Oct 31 19:32:13.090473 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-bef0dc47-8a42-42a3-a432-703527e4a116 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Request method failure captured: Oct 31 19:32:13.090473 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: request: GET /compute/v2.1/servers/a3be5488-67cf-4a84-ae40-9c0bf189ffd1 HTTP/1.1 Oct 31 19:32:13.090473 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: Accept: application/json Oct 31 19:32:13.090473 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: Accept-Encoding: identity Oct 31 19:32:13.090473 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: Connection: close Oct 31 19:32:13.090473 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: Content-Length: 0 Oct 31 19:32:13.090473 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: Content-Type: application/json Oct 31 19:32:13.090473 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: Host: 10.222.0.16 Oct 31 19:32:13.090473 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: Openstack-System-Scope: None Oct 31 19:32:13.090473 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: User-Agent: python-urllib3/1.26.12 Oct 31 19:32:13.090473 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Auth-Token: gAAAAABjYCG5aDHxCXWKl54hrIP8uylj79sP0BDeZd_ckOPD9KTXbM2ReEx2xP85m13HtVq0_y1CIML9YTOWHjoWbtPsbViKMinP0f-u0wr8bnwCjlILH4aKfybx_z4WSYI8NEE_nzlMlhmG0HnRtdfd3ZDvw9RFGweGeDxD4VM0dXtgMk2CUO4 Oct 31 19:32:13.090473 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Domain-Id: None Oct 31 19:32:13.090473 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Domain-Name: None Oct 31 19:32:13.090473 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Identity-Status: Confirmed Oct 31 19:32:13.090473 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Is-Admin-Project: True Oct 31 19:32:13.090473 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Project-Domain-Id: default Oct 31 19:32:13.090473 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Project-Domain-Name: Default Oct 31 19:32:13.090473 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Project-Id: adba9bc456234ea6ade63d41a1624967 Oct 31 19:32:13.090473 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Project-Name: tempest-AttachVolumeNegativeTest-1656947587 Oct 31 19:32:13.090473 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Role: member,reader Oct 31 19:32:13.090473 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Roles: member,reader Oct 31 19:32:13.092086 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/adba9bc456234ea6ade63d41a1624967"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_adba9bc456234ea6ade63d41a1624967", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/adba9bc456234ea6ade63d41a1624967"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/adba9bc456234ea6ade63d41a1624967"}]}] Oct 31 19:32:13.092086 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Tenant: tempest-AttachVolumeNegativeTest-1656947587 Oct 31 19:32:13.092086 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Tenant-Id: adba9bc456234ea6ade63d41a1624967 Oct 31 19:32:13.092086 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1656947587 Oct 31 19:32:13.092086 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-User: tempest-AttachVolumeNegativeTest-1656947587-project Oct 31 19:32:13.092086 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-User-Domain-Id: default Oct 31 19:32:13.092086 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-User-Domain-Name: Default Oct 31 19:32:13.092086 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-User-Id: 16778b0dd21d41eeaa6087b67931eef8 Oct 31 19:32:13.092086 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-User-Name: tempest-AttachVolumeNegativeTest-1656947587-project Oct 31 19:32:13.092086 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: method: > Oct 31 19:32:13.092086 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: exception: Instance a3be5488-67cf-4a84-ae40-9c0bf189ffd1 could not be found. Oct 31 19:32:13.092086 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: action_args: {'id': 'a3be5488-67cf-4a84-ae40-9c0bf189ffd1'} Oct 31 19:32:13.092938 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 19:32:13.092938 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:32:13.092938 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 19:32:13.092938 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 19:32:13.092938 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 19:32:13.092938 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 19:32:13.092938 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 19:32:13.092938 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 19:32:13.092938 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 19:32:13.092938 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 19:32:13.092938 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3be5488-67cf-4a84-ae40-9c0bf189ffd1 could not be found. Oct 31 19:32:13.092938 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Oct 31 19:32:13.092938 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 19:32:13.092938 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Oct 31 19:32:13.092938 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:32:13.092938 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 19:32:13.092938 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 19:32:13.092938 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 19:32:13.092938 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 19:32:13.092938 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 19:32:13.094453 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 19:32:13.094453 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 19:32:13.094453 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 19:32:13.094453 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 19:32:13.094453 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 19:32:13.094453 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 19:32:13.094453 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 19:32:13.094453 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3be5488-67cf-4a84-ae40-9c0bf189ffd1 could not be found. Oct 31 19:32:13.094453 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Oct 31 19:32:13.094453 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 19:32:13.094453 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Oct 31 19:32:13.094453 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:32:13.094453 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 19:32:13.094453 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 19:32:13.094453 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 19:32:13.094453 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 19:32:13.094453 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3be5488-67cf-4a84-ae40-9c0bf189ffd1 could not be found. Oct 31 19:32:13.094453 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Oct 31 19:32:13.095797 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-bef0dc47-8a42-42a3-a432-703527e4a116 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Returning 404 to user: Instance a3be5488-67cf-4a84-ae40-9c0bf189ffd1 could not be found. {{(pid=118726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 19:32:13.095797 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-bef0dc47-8a42-42a3-a432-703527e4a116 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] 10.222.0.16 "GET /compute/v2.1/servers/a3be5488-67cf-4a84-ae40-9c0bf189ffd1" status: 404 len: 111 microversion: 2.1 time: 0.031412 Oct 31 19:32:13.095797 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 534/1064] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:32:13 2022] GET /compute/v2.1/servers/a3be5488-67cf-4a84-ae40-9c0bf189ffd1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 19:32:14.228547 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-c2583063-4a5a-42bf-b88a-65aa48bcbb28 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:32:14.229043 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-c2583063-4a5a-42bf-b88a-65aa48bcbb28 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] [instance: 1fd43154-badc-47b6-a5a7-d1f28e759bb0] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:32:14.235338 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-c2583063-4a5a-42bf-b88a-65aa48bcbb28 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:32:14.235825 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-c2583063-4a5a-42bf-b88a-65aa48bcbb28 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:32:14.236258 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-c2583063-4a5a-42bf-b88a-65aa48bcbb28 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:32:14.236943 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-c2583063-4a5a-42bf-b88a-65aa48bcbb28 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:32:14.237394 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-c2583063-4a5a-42bf-b88a-65aa48bcbb28 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:32:14.237850 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-c2583063-4a5a-42bf-b88a-65aa48bcbb28 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:32:14.250772 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.wsgi [None req-c2583063-4a5a-42bf-b88a-65aa48bcbb28 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] HTTP exception thrown: Instance 1fd43154-badc-47b6-a5a7-d1f28e759bb0 could not be found. Oct 31 19:32:14.252294 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-c2583063-4a5a-42bf-b88a-65aa48bcbb28 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Request method failure captured: Oct 31 19:32:14.252294 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: request: DELETE /compute/v2.1/servers/1fd43154-badc-47b6-a5a7-d1f28e759bb0 HTTP/1.1 Oct 31 19:32:14.252294 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Accept: application/json Oct 31 19:32:14.252294 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Accept-Encoding: identity Oct 31 19:32:14.252294 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Connection: close Oct 31 19:32:14.252294 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Content-Length: 0 Oct 31 19:32:14.252294 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Content-Type: application/json Oct 31 19:32:14.252294 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Host: 10.222.0.16 Oct 31 19:32:14.252294 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Openstack-System-Scope: None Oct 31 19:32:14.252294 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: User-Agent: python-urllib3/1.26.12 Oct 31 19:32:14.252294 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Auth-Token: gAAAAABjYCG5aDHxCXWKl54hrIP8uylj79sP0BDeZd_ckOPD9KTXbM2ReEx2xP85m13HtVq0_y1CIML9YTOWHjoWbtPsbViKMinP0f-u0wr8bnwCjlILH4aKfybx_z4WSYI8NEE_nzlMlhmG0HnRtdfd3ZDvw9RFGweGeDxD4VM0dXtgMk2CUO4 Oct 31 19:32:14.252294 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Domain-Id: None Oct 31 19:32:14.252294 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Domain-Name: None Oct 31 19:32:14.252294 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Identity-Status: Confirmed Oct 31 19:32:14.252294 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Is-Admin-Project: True Oct 31 19:32:14.252294 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Project-Domain-Id: default Oct 31 19:32:14.252294 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Project-Domain-Name: Default Oct 31 19:32:14.252294 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Project-Id: adba9bc456234ea6ade63d41a1624967 Oct 31 19:32:14.252294 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Project-Name: tempest-AttachVolumeNegativeTest-1656947587 Oct 31 19:32:14.252294 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Role: member,reader Oct 31 19:32:14.252294 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Roles: member,reader Oct 31 19:32:14.254013 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/adba9bc456234ea6ade63d41a1624967"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_adba9bc456234ea6ade63d41a1624967", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/adba9bc456234ea6ade63d41a1624967"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/adba9bc456234ea6ade63d41a1624967"}]}] Oct 31 19:32:14.254013 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Tenant: tempest-AttachVolumeNegativeTest-1656947587 Oct 31 19:32:14.254013 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Tenant-Id: adba9bc456234ea6ade63d41a1624967 Oct 31 19:32:14.254013 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1656947587 Oct 31 19:32:14.254013 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User: tempest-AttachVolumeNegativeTest-1656947587-project Oct 31 19:32:14.254013 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User-Domain-Id: default Oct 31 19:32:14.254013 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User-Domain-Name: Default Oct 31 19:32:14.254013 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User-Id: 16778b0dd21d41eeaa6087b67931eef8 Oct 31 19:32:14.254013 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User-Name: tempest-AttachVolumeNegativeTest-1656947587-project Oct 31 19:32:14.254013 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: method: > Oct 31 19:32:14.254013 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: exception: Instance 1fd43154-badc-47b6-a5a7-d1f28e759bb0 could not be found. Oct 31 19:32:14.254013 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: action_args: {'id': '1fd43154-badc-47b6-a5a7-d1f28e759bb0'} Oct 31 19:32:14.255149 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 19:32:14.255149 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:32:14.255149 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 19:32:14.255149 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 19:32:14.255149 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 19:32:14.255149 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 19:32:14.255149 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 19:32:14.255149 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 19:32:14.255149 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 19:32:14.255149 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 19:32:14.255149 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1fd43154-badc-47b6-a5a7-d1f28e759bb0 could not be found. Oct 31 19:32:14.255149 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:32:14.255149 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 19:32:14.255149 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:32:14.255149 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:32:14.255149 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 19:32:14.255149 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 19:32:14.255149 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 19:32:14.255149 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 19:32:14.255149 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 19:32:14.256811 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 19:32:14.256811 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 19:32:14.256811 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 19:32:14.256811 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 19:32:14.256811 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 19:32:14.256811 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 19:32:14.256811 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 19:32:14.256811 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 19:32:14.256811 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 19:32:14.256811 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1fd43154-badc-47b6-a5a7-d1f28e759bb0 could not be found. Oct 31 19:32:14.256811 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:32:14.256811 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 19:32:14.256811 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:32:14.256811 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:32:14.256811 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 19:32:14.256811 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 19:32:14.256811 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 19:32:14.256811 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 19:32:14.256811 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1fd43154-badc-47b6-a5a7-d1f28e759bb0 could not be found. Oct 31 19:32:14.256811 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:32:14.258295 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-c2583063-4a5a-42bf-b88a-65aa48bcbb28 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Returning 404 to user: Instance 1fd43154-badc-47b6-a5a7-d1f28e759bb0 could not be found. {{(pid=118727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 19:32:14.258295 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-c2583063-4a5a-42bf-b88a-65aa48bcbb28 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] 10.222.0.16 "DELETE /compute/v2.1/servers/1fd43154-badc-47b6-a5a7-d1f28e759bb0" status: 404 len: 111 microversion: 2.1 time: 0.028991 Oct 31 19:32:14.258295 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 531/1065] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 31 19:32:14 2022] DELETE /compute/v2.1/servers/1fd43154-badc-47b6-a5a7-d1f28e759bb0 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 19:32:14.261732 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-2fde6c30-aae6-4e91-8688-5bf3e180fe68 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:32:14.262830 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-2fde6c30-aae6-4e91-8688-5bf3e180fe68 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] [instance: 1fd43154-badc-47b6-a5a7-d1f28e759bb0] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:32:14.269142 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-2fde6c30-aae6-4e91-8688-5bf3e180fe68 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:32:14.269634 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-2fde6c30-aae6-4e91-8688-5bf3e180fe68 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:32:14.270078 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-2fde6c30-aae6-4e91-8688-5bf3e180fe68 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:32:14.270757 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-2fde6c30-aae6-4e91-8688-5bf3e180fe68 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:32:14.271211 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-2fde6c30-aae6-4e91-8688-5bf3e180fe68 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:32:14.271631 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-2fde6c30-aae6-4e91-8688-5bf3e180fe68 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:32:14.285306 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.wsgi [None req-2fde6c30-aae6-4e91-8688-5bf3e180fe68 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] HTTP exception thrown: Instance 1fd43154-badc-47b6-a5a7-d1f28e759bb0 could not be found. Oct 31 19:32:14.286887 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-2fde6c30-aae6-4e91-8688-5bf3e180fe68 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Request method failure captured: Oct 31 19:32:14.286887 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: request: GET /compute/v2.1/servers/1fd43154-badc-47b6-a5a7-d1f28e759bb0 HTTP/1.1 Oct 31 19:32:14.286887 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: Accept: application/json Oct 31 19:32:14.286887 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: Accept-Encoding: identity Oct 31 19:32:14.286887 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: Connection: close Oct 31 19:32:14.286887 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: Content-Length: 0 Oct 31 19:32:14.286887 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: Content-Type: application/json Oct 31 19:32:14.286887 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: Host: 10.222.0.16 Oct 31 19:32:14.286887 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: Openstack-System-Scope: None Oct 31 19:32:14.286887 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: User-Agent: python-urllib3/1.26.12 Oct 31 19:32:14.286887 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Auth-Token: gAAAAABjYCG5aDHxCXWKl54hrIP8uylj79sP0BDeZd_ckOPD9KTXbM2ReEx2xP85m13HtVq0_y1CIML9YTOWHjoWbtPsbViKMinP0f-u0wr8bnwCjlILH4aKfybx_z4WSYI8NEE_nzlMlhmG0HnRtdfd3ZDvw9RFGweGeDxD4VM0dXtgMk2CUO4 Oct 31 19:32:14.286887 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Domain-Id: None Oct 31 19:32:14.286887 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Domain-Name: None Oct 31 19:32:14.286887 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Identity-Status: Confirmed Oct 31 19:32:14.286887 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Is-Admin-Project: True Oct 31 19:32:14.286887 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Project-Domain-Id: default Oct 31 19:32:14.286887 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Project-Domain-Name: Default Oct 31 19:32:14.286887 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Project-Id: adba9bc456234ea6ade63d41a1624967 Oct 31 19:32:14.286887 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Project-Name: tempest-AttachVolumeNegativeTest-1656947587 Oct 31 19:32:14.286887 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Role: member,reader Oct 31 19:32:14.286887 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Roles: member,reader Oct 31 19:32:14.288765 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/adba9bc456234ea6ade63d41a1624967"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_adba9bc456234ea6ade63d41a1624967", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/adba9bc456234ea6ade63d41a1624967"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/adba9bc456234ea6ade63d41a1624967"}]}] Oct 31 19:32:14.288765 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Tenant: tempest-AttachVolumeNegativeTest-1656947587 Oct 31 19:32:14.288765 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Tenant-Id: adba9bc456234ea6ade63d41a1624967 Oct 31 19:32:14.288765 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1656947587 Oct 31 19:32:14.288765 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-User: tempest-AttachVolumeNegativeTest-1656947587-project Oct 31 19:32:14.288765 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-User-Domain-Id: default Oct 31 19:32:14.288765 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-User-Domain-Name: Default Oct 31 19:32:14.288765 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-User-Id: 16778b0dd21d41eeaa6087b67931eef8 Oct 31 19:32:14.288765 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: X-User-Name: tempest-AttachVolumeNegativeTest-1656947587-project Oct 31 19:32:14.288765 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: method: > Oct 31 19:32:14.288765 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: exception: Instance 1fd43154-badc-47b6-a5a7-d1f28e759bb0 could not be found. Oct 31 19:32:14.288765 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: action_args: {'id': '1fd43154-badc-47b6-a5a7-d1f28e759bb0'} Oct 31 19:32:14.289858 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 19:32:14.289858 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:32:14.289858 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 19:32:14.289858 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 19:32:14.289858 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 19:32:14.289858 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 19:32:14.289858 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 19:32:14.289858 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 19:32:14.289858 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 19:32:14.289858 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 19:32:14.289858 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1fd43154-badc-47b6-a5a7-d1f28e759bb0 could not be found. Oct 31 19:32:14.289858 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Oct 31 19:32:14.289858 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 19:32:14.289858 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Oct 31 19:32:14.289858 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:32:14.289858 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 19:32:14.289858 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 19:32:14.289858 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 19:32:14.289858 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 19:32:14.289858 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 19:32:14.291386 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 19:32:14.291386 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 19:32:14.291386 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 19:32:14.291386 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 19:32:14.291386 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 19:32:14.291386 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 19:32:14.291386 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 19:32:14.291386 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1fd43154-badc-47b6-a5a7-d1f28e759bb0 could not be found. Oct 31 19:32:14.291386 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Oct 31 19:32:14.291386 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 19:32:14.291386 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Oct 31 19:32:14.291386 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:32:14.291386 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 19:32:14.291386 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 19:32:14.291386 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 19:32:14.291386 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 19:32:14.291386 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1fd43154-badc-47b6-a5a7-d1f28e759bb0 could not be found. Oct 31 19:32:14.291386 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: ERROR nova.api.openstack.wsgi Oct 31 19:32:14.292914 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-2fde6c30-aae6-4e91-8688-5bf3e180fe68 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] Returning 404 to user: Instance 1fd43154-badc-47b6-a5a7-d1f28e759bb0 could not be found. {{(pid=118726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 19:32:14.292914 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-2fde6c30-aae6-4e91-8688-5bf3e180fe68 tempest-AttachVolumeNegativeTest-1656947587 tempest-AttachVolumeNegativeTest-1656947587-project] 10.222.0.16 "GET /compute/v2.1/servers/1fd43154-badc-47b6-a5a7-d1f28e759bb0" status: 404 len: 111 microversion: 2.1 time: 0.030302 Oct 31 19:32:14.292914 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 535/1066] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:32:14 2022] GET /compute/v2.1/servers/1fd43154-badc-47b6-a5a7-d1f28e759bb0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 19:32:19.613773 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-4c60cfec-e4f7-4a41-9e2f-707ee4c7c1ac tempest-VolumesTestJSON-114649612 tempest-VolumesTestJSON-114649612-project] Calling method '.version_select at 0x7f34f58c9ca0>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:32:19.661964 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-4c60cfec-e4f7-4a41-9e2f-707ee4c7c1ac tempest-VolumesTestJSON-114649612 tempest-VolumesTestJSON-114649612-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/2d1f4bf8-4fc4-4007-9911-77b35174d40c" status: 200 len: 351 microversion: 2.1 time: 0.051887 Oct 31 19:32:19.662523 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 532/1067] 10.222.0.16 () {58 vars in 1245 bytes} [Mon Oct 31 19:32:19 2022] GET /compute/v2.1/os-volumes/2d1f4bf8-4fc4-4007-9911-77b35174d40c => generated 351 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:32:20.995788 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-dcc9e641-6757-4962-898d-4a3900f77a69 tempest-VolumesTestJSON-114649612 tempest-VolumesTestJSON-114649612-project] Calling method '.version_select at 0x7f34f23d19d0>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:32:21.043895 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-dcc9e641-6757-4962-898d-4a3900f77a69 tempest-VolumesTestJSON-114649612 tempest-VolumesTestJSON-114649612-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/405409ab-3e1a-47f2-b1c9-fb04badf866e" status: 200 len: 350 microversion: 2.1 time: 0.051217 Oct 31 19:32:21.044448 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 536/1068] 10.222.0.16 () {58 vars in 1245 bytes} [Mon Oct 31 19:32:20 2022] GET /compute/v2.1/os-volumes/405409ab-3e1a-47f2-b1c9-fb04badf866e => generated 350 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:32:22.371737 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-5c02a658-21df-4f24-bc0a-3aa749689d4d tempest-VolumesTestJSON-114649612 tempest-VolumesTestJSON-114649612-project] Calling method '.version_select at 0x7f34f1fbfe50>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:32:22.417428 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-5c02a658-21df-4f24-bc0a-3aa749689d4d tempest-VolumesTestJSON-114649612 tempest-VolumesTestJSON-114649612-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/0afcf68f-4414-403f-9d5e-12244df66a3e" status: 200 len: 351 microversion: 2.1 time: 0.049956 Oct 31 19:32:22.418049 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 533/1069] 10.222.0.16 () {58 vars in 1245 bytes} [Mon Oct 31 19:32:22 2022] GET /compute/v2.1/os-volumes/0afcf68f-4414-403f-9d5e-12244df66a3e => generated 351 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:32:22.431094 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-9be42fdb-244b-41bc-8331-033d05f58f46 tempest-VolumesTestJSON-114649612 tempest-VolumesTestJSON-114649612-project] Calling method '.version_select at 0x7f34f2011a60>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:32:22.509850 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-9be42fdb-244b-41bc-8331-033d05f58f46 tempest-VolumesTestJSON-114649612 tempest-VolumesTestJSON-114649612-project] 10.222.0.16 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.082818 Oct 31 19:32:22.510423 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 537/1070] 10.222.0.16 () {58 vars in 1134 bytes} [Mon Oct 31 19:32:22 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:32:22.525653 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-1baffe79-79b6-4cd3-b171-2773f0cd73a7 tempest-VolumesTestJSON-114649612 tempest-VolumesTestJSON-114649612-project] Calling method '.version_select at 0x7f34f1f84790>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:32:22.606602 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-1baffe79-79b6-4cd3-b171-2773f0cd73a7 tempest-VolumesTestJSON-114649612 tempest-VolumesTestJSON-114649612-project] 10.222.0.16 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.084862 Oct 31 19:32:22.607159 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 534/1071] 10.222.0.16 () {58 vars in 1149 bytes} [Mon Oct 31 19:32:22 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:32:22.620432 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-055da579-0f40-401b-9133-642dce2e9e97 tempest-VolumesTestJSON-114649612 tempest-VolumesTestJSON-114649612-project] Calling method '.version_select at 0x7f34f23de700>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:32:22.702065 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-055da579-0f40-401b-9133-642dce2e9e97 tempest-VolumesTestJSON-114649612 tempest-VolumesTestJSON-114649612-project] 10.222.0.16 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.085210 Oct 31 19:32:22.702631 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 538/1072] 10.222.0.16 () {58 vars in 1134 bytes} [Mon Oct 31 19:32:22 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:32:22.715457 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-c81dc9a8-033b-4d54-b3d5-8e0855b3e944 tempest-VolumesTestJSON-114649612 tempest-VolumesTestJSON-114649612-project] Calling method '.version_select at 0x7f34f23160d0>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:32:22.798200 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-c81dc9a8-033b-4d54-b3d5-8e0855b3e944 tempest-VolumesTestJSON-114649612 tempest-VolumesTestJSON-114649612-project] 10.222.0.16 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.086425 Oct 31 19:32:22.798769 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 535/1073] 10.222.0.16 () {58 vars in 1167 bytes} [Mon Oct 31 19:32:22 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:32:22.812592 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-e4971ca7-a9b5-4b2a-8d35-1c7a36fe7119 tempest-VolumesTestJSON-114649612 tempest-VolumesTestJSON-114649612-project] Calling method '.version_select at 0x7f34f2363ee0>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:32:23.065915 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-e4971ca7-a9b5-4b2a-8d35-1c7a36fe7119 tempest-VolumesTestJSON-114649612 tempest-VolumesTestJSON-114649612-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.257501 Oct 31 19:32:23.066485 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 539/1074] 10.222.0.16 () {58 vars in 1170 bytes} [Mon Oct 31 19:32:22 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:32:23.079895 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-764340b3-0cf5-43ac-95d9-783329d30d31 tempest-VolumesTestJSON-114649612 tempest-VolumesTestJSON-114649612-project] Calling method '.version_select at 0x7f34f5893700>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:32:23.159218 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-764340b3-0cf5-43ac-95d9-783329d30d31 tempest-VolumesTestJSON-114649612 tempest-VolumesTestJSON-114649612-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.082983 Oct 31 19:32:23.159814 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 536/1075] 10.222.0.16 () {58 vars in 1155 bytes} [Mon Oct 31 19:32:23 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:32:23.174087 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-0e0f89ce-fd5e-4191-8151-2ad3925be7ae tempest-VolumesTestJSON-114649612 tempest-VolumesTestJSON-114649612-project] Calling method '.version_select at 0x7f34f22803a0>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:32:23.254160 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-0e0f89ce-fd5e-4191-8151-2ad3925be7ae tempest-VolumesTestJSON-114649612 tempest-VolumesTestJSON-114649612-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.083752 Oct 31 19:32:23.254727 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 540/1076] 10.222.0.16 () {58 vars in 1188 bytes} [Mon Oct 31 19:32:23 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:32:23.267810 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-16a3150f-8d03-4ee8-9cd5-0081775cc464 tempest-VolumesTestJSON-114649612 tempest-VolumesTestJSON-114649612-project] Calling method '.version_select at 0x7f34f1fdf040>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:32:23.350462 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-16a3150f-8d03-4ee8-9cd5-0081775cc464 tempest-VolumesTestJSON-114649612 tempest-VolumesTestJSON-114649612-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.086327 Oct 31 19:32:23.351053 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 537/1077] 10.222.0.16 () {58 vars in 1155 bytes} [Mon Oct 31 19:32:23 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:32:44.160543 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG dbcounter [-] [118726] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:32:44.161342 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG dbcounter [-] [118726] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:32:44.165782 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-65071814-f15d-44e8-89b9-d4678b5ad15b tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-304929420", "imageRef": "a9795ee0-6722-4e1e-8fc8-a6c2e68f3049", "flavorRef": "452", "networks": [{"uuid": "475ad199-f6f5-418f-b192-8d0beeadb839"}]}} {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:32:44.220714 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.network.neutron [None req-65071814-f15d-44e8-89b9-d4678b5ad15b tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] validate_networks() for [('475ad199-f6f5-418f-b192-8d0beeadb839', None, None, None, None, None)] {{(pid=118726) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 19:32:44.605885 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.virt.hardware [None req-65071814-f15d-44e8-89b9-d4678b5ad15b tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Flavor limits 0:0:0 {{(pid=118726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 19:32:44.606305 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.virt.hardware [None req-65071814-f15d-44e8-89b9-d4678b5ad15b tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Image limits 0:0:0 {{(pid=118726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 19:32:44.606775 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.virt.hardware [None req-65071814-f15d-44e8-89b9-d4678b5ad15b tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Flavor pref 0:0:0 {{(pid=118726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 19:32:44.607183 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.virt.hardware [None req-65071814-f15d-44e8-89b9-d4678b5ad15b tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Image pref 0:0:0 {{(pid=118726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 19:32:44.607596 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.virt.hardware [None req-65071814-f15d-44e8-89b9-d4678b5ad15b tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 19:32:44.618450 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-65071814-f15d-44e8-89b9-d4678b5ad15b tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:32:44.618928 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-65071814-f15d-44e8-89b9-d4678b5ad15b tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:32:44.619362 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-65071814-f15d-44e8-89b9-d4678b5ad15b tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:32:44.620078 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-65071814-f15d-44e8-89b9-d4678b5ad15b tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:32:44.620533 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-65071814-f15d-44e8-89b9-d4678b5ad15b tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:32:44.621025 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-65071814-f15d-44e8-89b9-d4678b5ad15b tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:32:44.639432 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.quota [None req-65071814-f15d-44e8-89b9-d4678b5ad15b tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Getting quotas for project 9efd35f792404278b5122bc4bca1bf7c. Resources: {'instances', 'ram', 'cores'} {{(pid=118726) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 19:32:44.643362 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.quota [None req-65071814-f15d-44e8-89b9-d4678b5ad15b tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Getting quotas for user 5d684a93ea334181be5af287d9fca534 and project 9efd35f792404278b5122bc4bca1bf7c. Resources: {'instances', 'ram', 'cores'} {{(pid=118726) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 19:32:44.654077 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-65071814-f15d-44e8-89b9-d4678b5ad15b tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Going to run 1 instances... {{(pid=118726) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 19:32:44.656328 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-65071814-f15d-44e8-89b9-d4678b5ad15b tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] [instance: 92c4a4f7-d1cf-4621-9e75-4a6ac740c2ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9795ee0-6722-4e1e-8fc8-a6c2e68f3049',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118726) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 19:32:44.703036 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-65071814-f15d-44e8-89b9-d4678b5ad15b tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.543700 Oct 31 19:32:44.703842 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 541/1078] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 31 19:32:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 545 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 19:32:44.712133 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG dbcounter [-] [118727] Writing DB stats nova_api:SELECT=20 {{(pid=118727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:32:44.713399 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG dbcounter [-] [118727] Writing DB stats nova_cell1:SELECT=37,nova_cell1:INSERT=1 {{(pid=118727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:32:44.717565 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-df1aa7db-461f-44e9-8f5a-221e4bf17ad8 tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:32:44.718275 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-df1aa7db-461f-44e9-8f5a-221e4bf17ad8 tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] [instance: 92c4a4f7-d1cf-4621-9e75-4a6ac740c2ab] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:32:44.778534 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-df1aa7db-461f-44e9-8f5a-221e4bf17ad8 tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d684a93ea334181be5af287d9fca534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9efd35f792404278b5122bc4bca1bf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:32:44.785349 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-df1aa7db-461f-44e9-8f5a-221e4bf17ad8 tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] 10.222.0.16 "GET /compute/v2.1/servers/92c4a4f7-d1cf-4621-9e75-4a6ac740c2ab" status: 200 len: 1213 microversion: 2.1 time: 0.074608 Oct 31 19:32:44.785951 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 538/1079] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:32:44 2022] GET /compute/v2.1/servers/92c4a4f7-d1cf-4621-9e75-4a6ac740c2ab => generated 1213 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:32:45.809429 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-2a659ec8-a22b-40a4-9a40-d5e8cb556496 tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:32:45.810169 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-2a659ec8-a22b-40a4-9a40-d5e8cb556496 tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] [instance: 92c4a4f7-d1cf-4621-9e75-4a6ac740c2ab] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:32:45.816234 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-2a659ec8-a22b-40a4-9a40-d5e8cb556496 tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:32:45.816720 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-2a659ec8-a22b-40a4-9a40-d5e8cb556496 tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:32:45.817161 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-2a659ec8-a22b-40a4-9a40-d5e8cb556496 tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:32:45.817901 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-2a659ec8-a22b-40a4-9a40-d5e8cb556496 tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:32:45.818380 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-2a659ec8-a22b-40a4-9a40-d5e8cb556496 tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:32:45.818824 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-2a659ec8-a22b-40a4-9a40-d5e8cb556496 tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:32:45.881216 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-2a659ec8-a22b-40a4-9a40-d5e8cb556496 tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d684a93ea334181be5af287d9fca534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9efd35f792404278b5122bc4bca1bf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:32:45.889385 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-2a659ec8-a22b-40a4-9a40-d5e8cb556496 tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] 10.222.0.16 "GET /compute/v2.1/servers/92c4a4f7-d1cf-4621-9e75-4a6ac740c2ab" status: 200 len: 1271 microversion: 2.1 time: 0.084796 Oct 31 19:32:45.889977 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 542/1080] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:32:45 2022] GET /compute/v2.1/servers/92c4a4f7-d1cf-4621-9e75-4a6ac740c2ab => generated 1271 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:32:46.911571 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-46be8089-894c-4548-bc46-2fe1154107e2 tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:32:46.912193 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-46be8089-894c-4548-bc46-2fe1154107e2 tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] [instance: 92c4a4f7-d1cf-4621-9e75-4a6ac740c2ab] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:32:46.919497 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-46be8089-894c-4548-bc46-2fe1154107e2 tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:32:46.919978 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-46be8089-894c-4548-bc46-2fe1154107e2 tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:32:46.920406 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-46be8089-894c-4548-bc46-2fe1154107e2 tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:32:46.921121 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-46be8089-894c-4548-bc46-2fe1154107e2 tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:32:46.921577 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-46be8089-894c-4548-bc46-2fe1154107e2 tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:32:46.922019 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-46be8089-894c-4548-bc46-2fe1154107e2 tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:32:46.963365 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [req-947d6077-7161-4844-86a4-c15c58728e99 req-9539cfea-5ab7-4539-ad6f-35f3926ae5be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92c4a4f7-d1cf-4621-9e75-4a6ac740c2ab", "tag": "8c6633eb-5177-4590-b4e4-d330f90b67c1"}]} {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:32:46.974414 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [req-947d6077-7161-4844-86a4-c15c58728e99 req-9539cfea-5ab7-4539-ad6f-35f3926ae5be service nova] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:32:46.974888 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [req-947d6077-7161-4844-86a4-c15c58728e99 req-9539cfea-5ab7-4539-ad6f-35f3926ae5be service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:32:46.975310 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [req-947d6077-7161-4844-86a4-c15c58728e99 req-9539cfea-5ab7-4539-ad6f-35f3926ae5be service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:32:46.986339 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.compute.server_external_events [req-947d6077-7161-4844-86a4-c15c58728e99 req-9539cfea-5ab7-4539-ad6f-35f3926ae5be service nova] Creating event network-changed:8c6633eb-5177-4590-b4e4-d330f90b67c1 for instance 92c4a4f7-d1cf-4621-9e75-4a6ac740c2ab on hv-cinder-86309 Oct 31 19:32:46.991613 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [req-947d6077-7161-4844-86a4-c15c58728e99 req-9539cfea-5ab7-4539-ad6f-35f3926ae5be service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031735 Oct 31 19:32:46.992232 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 543/1081] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 31 19:32:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:32:47.194103 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-46be8089-894c-4548-bc46-2fe1154107e2 tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d684a93ea334181be5af287d9fca534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9efd35f792404278b5122bc4bca1bf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:32:47.202443 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-46be8089-894c-4548-bc46-2fe1154107e2 tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] 10.222.0.16 "GET /compute/v2.1/servers/92c4a4f7-d1cf-4621-9e75-4a6ac740c2ab" status: 200 len: 1313 microversion: 2.1 time: 0.294705 Oct 31 19:32:47.203017 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 539/1082] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:32:46 2022] GET /compute/v2.1/servers/92c4a4f7-d1cf-4621-9e75-4a6ac740c2ab => generated 1313 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:32:48.226627 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-08536520-0e8b-4b8f-9d20-85ef70d56b7e tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:32:48.227342 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-08536520-0e8b-4b8f-9d20-85ef70d56b7e tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] [instance: 92c4a4f7-d1cf-4621-9e75-4a6ac740c2ab] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:32:48.234053 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-08536520-0e8b-4b8f-9d20-85ef70d56b7e tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:32:48.234529 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-08536520-0e8b-4b8f-9d20-85ef70d56b7e tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:32:48.234959 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-08536520-0e8b-4b8f-9d20-85ef70d56b7e tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:32:48.235640 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-08536520-0e8b-4b8f-9d20-85ef70d56b7e tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:32:48.236090 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-08536520-0e8b-4b8f-9d20-85ef70d56b7e tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:32:48.236510 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-08536520-0e8b-4b8f-9d20-85ef70d56b7e tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:32:48.363950 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-08536520-0e8b-4b8f-9d20-85ef70d56b7e tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d684a93ea334181be5af287d9fca534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9efd35f792404278b5122bc4bca1bf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:32:48.371996 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-08536520-0e8b-4b8f-9d20-85ef70d56b7e tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] 10.222.0.16 "GET /compute/v2.1/servers/92c4a4f7-d1cf-4621-9e75-4a6ac740c2ab" status: 200 len: 1313 microversion: 2.1 time: 0.149695 Oct 31 19:32:48.372504 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 544/1083] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:32:48 2022] GET /compute/v2.1/servers/92c4a4f7-d1cf-4621-9e75-4a6ac740c2ab => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:32:49.394416 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-c387b651-c9fd-4990-b665-8047e08f90f5 tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:32:49.395054 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-c387b651-c9fd-4990-b665-8047e08f90f5 tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] [instance: 92c4a4f7-d1cf-4621-9e75-4a6ac740c2ab] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:32:49.401342 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-c387b651-c9fd-4990-b665-8047e08f90f5 tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:32:49.401850 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-c387b651-c9fd-4990-b665-8047e08f90f5 tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:32:49.402282 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-c387b651-c9fd-4990-b665-8047e08f90f5 tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:32:49.402968 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-c387b651-c9fd-4990-b665-8047e08f90f5 tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:32:49.403424 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-c387b651-c9fd-4990-b665-8047e08f90f5 tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:32:49.403849 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-c387b651-c9fd-4990-b665-8047e08f90f5 tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:32:49.531015 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-c387b651-c9fd-4990-b665-8047e08f90f5 tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d684a93ea334181be5af287d9fca534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9efd35f792404278b5122bc4bca1bf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:32:49.539045 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-c387b651-c9fd-4990-b665-8047e08f90f5 tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] 10.222.0.16 "GET /compute/v2.1/servers/92c4a4f7-d1cf-4621-9e75-4a6ac740c2ab" status: 200 len: 1313 microversion: 2.1 time: 0.148278 Oct 31 19:32:49.539617 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 540/1084] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:32:49 2022] GET /compute/v2.1/servers/92c4a4f7-d1cf-4621-9e75-4a6ac740c2ab => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:32:50.562567 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-a8c8704f-9de5-4fc2-b076-541b4726038d tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:32:50.563175 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-a8c8704f-9de5-4fc2-b076-541b4726038d tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] [instance: 92c4a4f7-d1cf-4621-9e75-4a6ac740c2ab] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:32:50.569464 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-a8c8704f-9de5-4fc2-b076-541b4726038d tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:32:50.569972 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-a8c8704f-9de5-4fc2-b076-541b4726038d tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:32:50.570404 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-a8c8704f-9de5-4fc2-b076-541b4726038d tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:32:50.571084 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-a8c8704f-9de5-4fc2-b076-541b4726038d tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:32:50.571532 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-a8c8704f-9de5-4fc2-b076-541b4726038d tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:32:50.571951 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-a8c8704f-9de5-4fc2-b076-541b4726038d tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:32:50.700697 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-a8c8704f-9de5-4fc2-b076-541b4726038d tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d684a93ea334181be5af287d9fca534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9efd35f792404278b5122bc4bca1bf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:32:50.708162 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-a8c8704f-9de5-4fc2-b076-541b4726038d tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] 10.222.0.16 "GET /compute/v2.1/servers/92c4a4f7-d1cf-4621-9e75-4a6ac740c2ab" status: 200 len: 1313 microversion: 2.1 time: 0.149981 Oct 31 19:32:50.708748 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 545/1085] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:32:50 2022] GET /compute/v2.1/servers/92c4a4f7-d1cf-4621-9e75-4a6ac740c2ab => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:32:51.730414 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-7273c27f-cc39-42c5-9348-3d4542e776d3 tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:32:51.731179 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-7273c27f-cc39-42c5-9348-3d4542e776d3 tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] [instance: 92c4a4f7-d1cf-4621-9e75-4a6ac740c2ab] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:32:51.737578 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-7273c27f-cc39-42c5-9348-3d4542e776d3 tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:32:51.738187 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-7273c27f-cc39-42c5-9348-3d4542e776d3 tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:32:51.738856 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-7273c27f-cc39-42c5-9348-3d4542e776d3 tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:32:51.739770 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-7273c27f-cc39-42c5-9348-3d4542e776d3 tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:32:51.740328 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-7273c27f-cc39-42c5-9348-3d4542e776d3 tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:32:51.740847 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-7273c27f-cc39-42c5-9348-3d4542e776d3 tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:32:51.831381 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [req-f7fcd71e-0b56-433d-987d-510aa6337aae req-b1c75099-8319-4020-8b98-45df69ce0ca4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92c4a4f7-d1cf-4621-9e75-4a6ac740c2ab", "name": "network-vif-plugged", "status": "completed", "tag": "8c6633eb-5177-4590-b4e4-d330f90b67c1"}]} {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:32:51.840900 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [req-f7fcd71e-0b56-433d-987d-510aa6337aae req-b1c75099-8319-4020-8b98-45df69ce0ca4 service nova] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:32:51.841381 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [req-f7fcd71e-0b56-433d-987d-510aa6337aae req-b1c75099-8319-4020-8b98-45df69ce0ca4 service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:32:51.841836 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [req-f7fcd71e-0b56-433d-987d-510aa6337aae req-b1c75099-8319-4020-8b98-45df69ce0ca4 service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:32:51.852688 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.compute.server_external_events [req-f7fcd71e-0b56-433d-987d-510aa6337aae req-b1c75099-8319-4020-8b98-45df69ce0ca4 service nova] Creating event network-vif-plugged:8c6633eb-5177-4590-b4e4-d330f90b67c1 for instance 92c4a4f7-d1cf-4621-9e75-4a6ac740c2ab on hv-cinder-86309 Oct 31 19:32:51.857756 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [req-f7fcd71e-0b56-433d-987d-510aa6337aae req-b1c75099-8319-4020-8b98-45df69ce0ca4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.160892 Oct 31 19:32:51.858815 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 541/1086] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 31 19:32:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:32:51.876928 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-7273c27f-cc39-42c5-9348-3d4542e776d3 tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d684a93ea334181be5af287d9fca534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9efd35f792404278b5122bc4bca1bf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:32:51.885531 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-7273c27f-cc39-42c5-9348-3d4542e776d3 tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] 10.222.0.16 "GET /compute/v2.1/servers/92c4a4f7-d1cf-4621-9e75-4a6ac740c2ab" status: 200 len: 1313 microversion: 2.1 time: 0.158896 Oct 31 19:32:51.886131 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 546/1087] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:32:51 2022] GET /compute/v2.1/servers/92c4a4f7-d1cf-4621-9e75-4a6ac740c2ab => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 19:32:52.910325 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-382c0e89-ec5b-4d89-b2ec-8be55cb1514a tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:32:52.911032 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-382c0e89-ec5b-4d89-b2ec-8be55cb1514a tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] [instance: 92c4a4f7-d1cf-4621-9e75-4a6ac740c2ab] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:32:52.917257 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-382c0e89-ec5b-4d89-b2ec-8be55cb1514a tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:32:52.917777 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-382c0e89-ec5b-4d89-b2ec-8be55cb1514a tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:32:52.918310 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-382c0e89-ec5b-4d89-b2ec-8be55cb1514a tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:32:52.918998 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-382c0e89-ec5b-4d89-b2ec-8be55cb1514a tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:32:52.919449 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-382c0e89-ec5b-4d89-b2ec-8be55cb1514a tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:32:52.919869 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-382c0e89-ec5b-4d89-b2ec-8be55cb1514a tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:32:53.052911 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-382c0e89-ec5b-4d89-b2ec-8be55cb1514a tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d684a93ea334181be5af287d9fca534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9efd35f792404278b5122bc4bca1bf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:32:53.060560 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-382c0e89-ec5b-4d89-b2ec-8be55cb1514a tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] 10.222.0.16 "GET /compute/v2.1/servers/92c4a4f7-d1cf-4621-9e75-4a6ac740c2ab" status: 200 len: 1313 microversion: 2.1 time: 0.154985 Oct 31 19:32:53.061119 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 542/1088] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:32:52 2022] GET /compute/v2.1/servers/92c4a4f7-d1cf-4621-9e75-4a6ac740c2ab => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:32:54.083194 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-5613409c-779b-45ed-85d8-b9a455eebba7 tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:32:54.083806 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-5613409c-779b-45ed-85d8-b9a455eebba7 tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] [instance: 92c4a4f7-d1cf-4621-9e75-4a6ac740c2ab] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:32:54.090660 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-5613409c-779b-45ed-85d8-b9a455eebba7 tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:32:54.091170 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-5613409c-779b-45ed-85d8-b9a455eebba7 tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:32:54.091600 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-5613409c-779b-45ed-85d8-b9a455eebba7 tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:32:54.092276 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-5613409c-779b-45ed-85d8-b9a455eebba7 tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:32:54.092726 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-5613409c-779b-45ed-85d8-b9a455eebba7 tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:32:54.093148 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-5613409c-779b-45ed-85d8-b9a455eebba7 tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:32:54.223419 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-5613409c-779b-45ed-85d8-b9a455eebba7 tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d684a93ea334181be5af287d9fca534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9efd35f792404278b5122bc4bca1bf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:32:54.231727 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-5613409c-779b-45ed-85d8-b9a455eebba7 tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] 10.222.0.16 "GET /compute/v2.1/servers/92c4a4f7-d1cf-4621-9e75-4a6ac740c2ab" status: 200 len: 1497 microversion: 2.1 time: 0.152447 Oct 31 19:32:54.232292 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 547/1089] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:32:54 2022] GET /compute/v2.1/servers/92c4a4f7-d1cf-4621-9e75-4a6ac740c2ab => generated 1497 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:32:54.626675 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-4f80aeb3-ff9e-4808-8c83-b61cd59648c3 tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:32:54.627173 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-4f80aeb3-ff9e-4808-8c83-b61cd59648c3 tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] [instance: 92c4a4f7-d1cf-4621-9e75-4a6ac740c2ab] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:32:54.633411 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-4f80aeb3-ff9e-4808-8c83-b61cd59648c3 tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:32:54.633920 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-4f80aeb3-ff9e-4808-8c83-b61cd59648c3 tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:32:54.634356 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-4f80aeb3-ff9e-4808-8c83-b61cd59648c3 tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:32:54.635035 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-4f80aeb3-ff9e-4808-8c83-b61cd59648c3 tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:32:54.635489 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-4f80aeb3-ff9e-4808-8c83-b61cd59648c3 tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:32:54.635911 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-4f80aeb3-ff9e-4808-8c83-b61cd59648c3 tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:32:54.661402 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-4f80aeb3-ff9e-4808-8c83-b61cd59648c3 tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] [instance: 92c4a4f7-d1cf-4621-9e75-4a6ac740c2ab] Going to try to terminate instance {{(pid=118727) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 19:32:54.734510 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-4f80aeb3-ff9e-4808-8c83-b61cd59648c3 tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] 10.222.0.16 "DELETE /compute/v2.1/servers/92c4a4f7-d1cf-4621-9e75-4a6ac740c2ab" status: 204 len: 0 microversion: 2.1 time: 0.111404 Oct 31 19:32:54.735197 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 543/1090] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 31 19:32:54 2022] DELETE /compute/v2.1/servers/92c4a4f7-d1cf-4621-9e75-4a6ac740c2ab => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 19:32:54.743791 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-03f12d0e-21d5-4ad7-b4d4-aa6a18fbe2bf tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:32:54.744484 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-03f12d0e-21d5-4ad7-b4d4-aa6a18fbe2bf tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] [instance: 92c4a4f7-d1cf-4621-9e75-4a6ac740c2ab] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:32:54.746759 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG dbcounter [-] [118726] Writing DB stats nova_cell0:SELECT=2 {{(pid=118726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:32:54.747466 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG dbcounter [-] [118726] Writing DB stats nova_cell0:SELECT=6 {{(pid=118726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:32:54.753192 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-03f12d0e-21d5-4ad7-b4d4-aa6a18fbe2bf tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:32:54.753695 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-03f12d0e-21d5-4ad7-b4d4-aa6a18fbe2bf tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:32:54.754131 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-03f12d0e-21d5-4ad7-b4d4-aa6a18fbe2bf tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:32:54.754822 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-03f12d0e-21d5-4ad7-b4d4-aa6a18fbe2bf tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:32:54.755280 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-03f12d0e-21d5-4ad7-b4d4-aa6a18fbe2bf tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:32:54.755705 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-03f12d0e-21d5-4ad7-b4d4-aa6a18fbe2bf tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:32:54.884370 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-03f12d0e-21d5-4ad7-b4d4-aa6a18fbe2bf tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d684a93ea334181be5af287d9fca534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9efd35f792404278b5122bc4bca1bf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:32:54.892519 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-03f12d0e-21d5-4ad7-b4d4-aa6a18fbe2bf tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] 10.222.0.16 "GET /compute/v2.1/servers/92c4a4f7-d1cf-4621-9e75-4a6ac740c2ab" status: 200 len: 1503 microversion: 2.1 time: 0.152679 Oct 31 19:32:54.893072 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 548/1091] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:32:54 2022] GET /compute/v2.1/servers/92c4a4f7-d1cf-4621-9e75-4a6ac740c2ab => generated 1503 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:32:55.915871 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-61268f39-8af2-4999-bcfc-0b26e2d34865 tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:32:55.916569 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-61268f39-8af2-4999-bcfc-0b26e2d34865 tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] [instance: 92c4a4f7-d1cf-4621-9e75-4a6ac740c2ab] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:32:55.918565 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG dbcounter [-] [118727] Writing DB stats nova_cell0:SELECT=2 {{(pid=118727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:32:55.924149 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-61268f39-8af2-4999-bcfc-0b26e2d34865 tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:32:55.924627 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-61268f39-8af2-4999-bcfc-0b26e2d34865 tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:32:55.925057 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-61268f39-8af2-4999-bcfc-0b26e2d34865 tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:32:55.925782 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-61268f39-8af2-4999-bcfc-0b26e2d34865 tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:32:55.926240 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-61268f39-8af2-4999-bcfc-0b26e2d34865 tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:32:55.926662 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-61268f39-8af2-4999-bcfc-0b26e2d34865 tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:32:56.057149 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-61268f39-8af2-4999-bcfc-0b26e2d34865 tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d684a93ea334181be5af287d9fca534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9efd35f792404278b5122bc4bca1bf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:32:56.064778 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-61268f39-8af2-4999-bcfc-0b26e2d34865 tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] 10.222.0.16 "GET /compute/v2.1/servers/92c4a4f7-d1cf-4621-9e75-4a6ac740c2ab" status: 200 len: 1503 microversion: 2.1 time: 0.153420 Oct 31 19:32:56.065345 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 544/1092] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:32:55 2022] GET /compute/v2.1/servers/92c4a4f7-d1cf-4621-9e75-4a6ac740c2ab => generated 1503 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:32:56.534157 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [req-6b2df165-ce3d-485a-82ed-692b42fe01ee req-fb817edb-b69c-45d1-911d-3abb3e6eab35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92c4a4f7-d1cf-4621-9e75-4a6ac740c2ab", "name": "network-vif-deleted", "tag": "8c6633eb-5177-4590-b4e4-d330f90b67c1"}]} {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:32:56.547098 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [req-6b2df165-ce3d-485a-82ed-692b42fe01ee req-fb817edb-b69c-45d1-911d-3abb3e6eab35 service nova] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:32:56.547497 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [req-6b2df165-ce3d-485a-82ed-692b42fe01ee req-fb817edb-b69c-45d1-911d-3abb3e6eab35 service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:32:56.547936 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [req-6b2df165-ce3d-485a-82ed-692b42fe01ee req-fb817edb-b69c-45d1-911d-3abb3e6eab35 service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:32:56.561525 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.compute.server_external_events [req-6b2df165-ce3d-485a-82ed-692b42fe01ee req-fb817edb-b69c-45d1-911d-3abb3e6eab35 service nova] Creating event network-vif-deleted:8c6633eb-5177-4590-b4e4-d330f90b67c1 for instance 92c4a4f7-d1cf-4621-9e75-4a6ac740c2ab on hv-cinder-86309 Oct 31 19:32:56.566687 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [req-6b2df165-ce3d-485a-82ed-692b42fe01ee req-fb817edb-b69c-45d1-911d-3abb3e6eab35 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036768 Oct 31 19:32:56.567284 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 549/1093] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 31 19:32:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:32:57.087922 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-40db994d-da6f-45fc-8fee-f30ddce27793 tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:32:57.088532 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-40db994d-da6f-45fc-8fee-f30ddce27793 tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] [instance: 92c4a4f7-d1cf-4621-9e75-4a6ac740c2ab] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:32:57.095348 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-40db994d-da6f-45fc-8fee-f30ddce27793 tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:32:57.095824 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-40db994d-da6f-45fc-8fee-f30ddce27793 tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:32:57.096254 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-40db994d-da6f-45fc-8fee-f30ddce27793 tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:32:57.096930 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-40db994d-da6f-45fc-8fee-f30ddce27793 tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:32:57.097381 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-40db994d-da6f-45fc-8fee-f30ddce27793 tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:32:57.097845 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-40db994d-da6f-45fc-8fee-f30ddce27793 tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:32:57.111473 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.wsgi [None req-40db994d-da6f-45fc-8fee-f30ddce27793 tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] HTTP exception thrown: Instance 92c4a4f7-d1cf-4621-9e75-4a6ac740c2ab could not be found. Oct 31 19:32:57.113109 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-40db994d-da6f-45fc-8fee-f30ddce27793 tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Request method failure captured: Oct 31 19:32:57.113109 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: request: GET /compute/v2.1/servers/92c4a4f7-d1cf-4621-9e75-4a6ac740c2ab HTTP/1.1 Oct 31 19:32:57.113109 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Accept: application/json Oct 31 19:32:57.113109 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Accept-Encoding: identity Oct 31 19:32:57.113109 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Connection: close Oct 31 19:32:57.113109 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Content-Length: 0 Oct 31 19:32:57.113109 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Content-Type: application/json Oct 31 19:32:57.113109 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Host: 10.222.0.16 Oct 31 19:32:57.113109 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Openstack-System-Scope: None Oct 31 19:32:57.113109 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: User-Agent: python-urllib3/1.26.12 Oct 31 19:32:57.113109 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Auth-Token: gAAAAABjYCLaQh9UbohKWyj4LgOeohehcvKH8_saK3CxQtVNeAbYjO-eLfB04e4oj9Pt7s7b2A_x3qVULjqPTjaMd_4LR_YdU71n11-E5ArMUrZHbeVlzIKcXZX9yVFPY9OQFLLLMwZPRv719H40W-yzfpBMsOnJ3g4raPoCh_b7o7pxGKuVoT8 Oct 31 19:32:57.113109 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Domain-Id: None Oct 31 19:32:57.113109 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Domain-Name: None Oct 31 19:32:57.113109 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Identity-Status: Confirmed Oct 31 19:32:57.113109 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Is-Admin-Project: True Oct 31 19:32:57.113109 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Project-Domain-Id: default Oct 31 19:32:57.113109 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Project-Domain-Name: Default Oct 31 19:32:57.113109 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Project-Id: 9efd35f792404278b5122bc4bca1bf7c Oct 31 19:32:57.113109 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Project-Name: tempest-VolumesActionsTest-102418348 Oct 31 19:32:57.113109 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Role: member,reader Oct 31 19:32:57.113109 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Roles: member,reader Oct 31 19:32:57.114886 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9efd35f792404278b5122bc4bca1bf7c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9efd35f792404278b5122bc4bca1bf7c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9efd35f792404278b5122bc4bca1bf7c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9efd35f792404278b5122bc4bca1bf7c"}]}] Oct 31 19:32:57.114886 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Tenant: tempest-VolumesActionsTest-102418348 Oct 31 19:32:57.114886 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Tenant-Id: 9efd35f792404278b5122bc4bca1bf7c Oct 31 19:32:57.114886 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Tenant-Name: tempest-VolumesActionsTest-102418348 Oct 31 19:32:57.114886 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User: tempest-VolumesActionsTest-102418348-project Oct 31 19:32:57.114886 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User-Domain-Id: default Oct 31 19:32:57.114886 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User-Domain-Name: Default Oct 31 19:32:57.114886 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User-Id: 5d684a93ea334181be5af287d9fca534 Oct 31 19:32:57.114886 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User-Name: tempest-VolumesActionsTest-102418348-project Oct 31 19:32:57.114886 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: method: > Oct 31 19:32:57.114886 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: exception: Instance 92c4a4f7-d1cf-4621-9e75-4a6ac740c2ab could not be found. Oct 31 19:32:57.114886 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: action_args: {'id': '92c4a4f7-d1cf-4621-9e75-4a6ac740c2ab'} Oct 31 19:32:57.115811 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 19:32:57.115811 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:32:57.115811 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 19:32:57.115811 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 19:32:57.115811 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 19:32:57.115811 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 19:32:57.115811 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 19:32:57.115811 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 19:32:57.115811 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 19:32:57.115811 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 19:32:57.115811 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92c4a4f7-d1cf-4621-9e75-4a6ac740c2ab could not be found. Oct 31 19:32:57.115811 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:32:57.115811 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 19:32:57.115811 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:32:57.115811 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:32:57.115811 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 19:32:57.115811 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 19:32:57.115811 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 19:32:57.115811 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 19:32:57.115811 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 19:32:57.117482 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 19:32:57.117482 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 19:32:57.117482 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 19:32:57.117482 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 19:32:57.117482 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 19:32:57.117482 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 19:32:57.117482 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 19:32:57.117482 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92c4a4f7-d1cf-4621-9e75-4a6ac740c2ab could not be found. Oct 31 19:32:57.117482 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:32:57.117482 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 19:32:57.117482 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:32:57.117482 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:32:57.117482 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 19:32:57.117482 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 19:32:57.117482 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 19:32:57.117482 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 19:32:57.117482 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92c4a4f7-d1cf-4621-9e75-4a6ac740c2ab could not be found. Oct 31 19:32:57.117482 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:32:57.119406 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-40db994d-da6f-45fc-8fee-f30ddce27793 tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Returning 404 to user: Instance 92c4a4f7-d1cf-4621-9e75-4a6ac740c2ab could not be found. {{(pid=118727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 19:32:57.119406 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-40db994d-da6f-45fc-8fee-f30ddce27793 tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] 10.222.0.16 "GET /compute/v2.1/servers/92c4a4f7-d1cf-4621-9e75-4a6ac740c2ab" status: 404 len: 111 microversion: 2.1 time: 0.030530 Oct 31 19:32:57.119406 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 545/1094] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:32:57 2022] GET /compute/v2.1/servers/92c4a4f7-d1cf-4621-9e75-4a6ac740c2ab => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 19:32:57.165194 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-bc26a94e-e6a9-454d-888f-ff43e2d9091b tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-129190603", "imageRef": "a9795ee0-6722-4e1e-8fc8-a6c2e68f3049", "flavorRef": "452", "networks": [{"uuid": "475ad199-f6f5-418f-b192-8d0beeadb839"}]}} {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:32:57.217221 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.network.neutron [None req-bc26a94e-e6a9-454d-888f-ff43e2d9091b tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] validate_networks() for [('475ad199-f6f5-418f-b192-8d0beeadb839', None, None, None, None, None)] {{(pid=118726) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 19:32:57.559348 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.virt.hardware [None req-bc26a94e-e6a9-454d-888f-ff43e2d9091b tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Flavor limits 0:0:0 {{(pid=118726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 19:32:57.559912 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.virt.hardware [None req-bc26a94e-e6a9-454d-888f-ff43e2d9091b tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Image limits 0:0:0 {{(pid=118726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 19:32:57.560231 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.virt.hardware [None req-bc26a94e-e6a9-454d-888f-ff43e2d9091b tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Flavor pref 0:0:0 {{(pid=118726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 19:32:57.560638 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.virt.hardware [None req-bc26a94e-e6a9-454d-888f-ff43e2d9091b tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Image pref 0:0:0 {{(pid=118726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 19:32:57.561051 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.virt.hardware [None req-bc26a94e-e6a9-454d-888f-ff43e2d9091b tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 19:32:57.569744 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-bc26a94e-e6a9-454d-888f-ff43e2d9091b tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:32:57.570225 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-bc26a94e-e6a9-454d-888f-ff43e2d9091b tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:32:57.570655 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-bc26a94e-e6a9-454d-888f-ff43e2d9091b tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:32:57.571377 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-bc26a94e-e6a9-454d-888f-ff43e2d9091b tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:32:57.571831 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-bc26a94e-e6a9-454d-888f-ff43e2d9091b tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:32:57.572254 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-bc26a94e-e6a9-454d-888f-ff43e2d9091b tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:32:57.588964 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.quota [None req-bc26a94e-e6a9-454d-888f-ff43e2d9091b tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Getting quotas for project 9efd35f792404278b5122bc4bca1bf7c. Resources: {'instances', 'ram', 'cores'} {{(pid=118726) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 19:32:57.593735 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.quota [None req-bc26a94e-e6a9-454d-888f-ff43e2d9091b tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Getting quotas for user 5d684a93ea334181be5af287d9fca534 and project 9efd35f792404278b5122bc4bca1bf7c. Resources: {'instances', 'ram', 'cores'} {{(pid=118726) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 19:32:57.604341 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-bc26a94e-e6a9-454d-888f-ff43e2d9091b tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Going to run 1 instances... {{(pid=118726) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 19:32:57.606747 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-bc26a94e-e6a9-454d-888f-ff43e2d9091b tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] [instance: 049da0e3-2e81-4b8a-81b5-ee690e3661b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9795ee0-6722-4e1e-8fc8-a6c2e68f3049',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118726) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 19:32:57.651893 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-bc26a94e-e6a9-454d-888f-ff43e2d9091b tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.491215 Oct 31 19:32:57.653295 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 550/1095] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 31 19:32:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 493 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 19:32:57.664169 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-31a178de-4fc3-40c9-84ba-cc2b2dbf0bc6 tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:32:57.664779 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-31a178de-4fc3-40c9-84ba-cc2b2dbf0bc6 tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] [instance: 049da0e3-2e81-4b8a-81b5-ee690e3661b3] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:32:57.717984 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-31a178de-4fc3-40c9-84ba-cc2b2dbf0bc6 tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d684a93ea334181be5af287d9fca534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9efd35f792404278b5122bc4bca1bf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:32:57.724728 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-31a178de-4fc3-40c9-84ba-cc2b2dbf0bc6 tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] 10.222.0.16 "GET /compute/v2.1/servers/049da0e3-2e81-4b8a-81b5-ee690e3661b3" status: 200 len: 1213 microversion: 2.1 time: 0.064624 Oct 31 19:32:57.725509 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 546/1096] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:32:57 2022] GET /compute/v2.1/servers/049da0e3-2e81-4b8a-81b5-ee690e3661b3 => generated 1213 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:32:58.747312 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-399563f7-283b-4c8a-8b5c-b48042eca3fc tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:32:58.748089 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-399563f7-283b-4c8a-8b5c-b48042eca3fc tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] [instance: 049da0e3-2e81-4b8a-81b5-ee690e3661b3] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:32:58.755110 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-399563f7-283b-4c8a-8b5c-b48042eca3fc tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:32:58.755591 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-399563f7-283b-4c8a-8b5c-b48042eca3fc tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:32:58.756026 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-399563f7-283b-4c8a-8b5c-b48042eca3fc tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:32:58.756717 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-399563f7-283b-4c8a-8b5c-b48042eca3fc tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:32:58.757170 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-399563f7-283b-4c8a-8b5c-b48042eca3fc tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:32:58.757593 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-399563f7-283b-4c8a-8b5c-b48042eca3fc tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:32:58.820330 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-399563f7-283b-4c8a-8b5c-b48042eca3fc tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d684a93ea334181be5af287d9fca534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9efd35f792404278b5122bc4bca1bf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:32:58.828101 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-399563f7-283b-4c8a-8b5c-b48042eca3fc tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] 10.222.0.16 "GET /compute/v2.1/servers/049da0e3-2e81-4b8a-81b5-ee690e3661b3" status: 200 len: 1271 microversion: 2.1 time: 0.085231 Oct 31 19:32:58.828670 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 551/1097] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:32:58 2022] GET /compute/v2.1/servers/049da0e3-2e81-4b8a-81b5-ee690e3661b3 => generated 1271 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:32:59.851937 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-ddc38b02-90d8-4f4c-9a61-96cfcb6dd418 tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:32:59.852630 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-ddc38b02-90d8-4f4c-9a61-96cfcb6dd418 tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] [instance: 049da0e3-2e81-4b8a-81b5-ee690e3661b3] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:32:59.863161 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-ddc38b02-90d8-4f4c-9a61-96cfcb6dd418 tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:32:59.863652 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-ddc38b02-90d8-4f4c-9a61-96cfcb6dd418 tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:32:59.864086 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-ddc38b02-90d8-4f4c-9a61-96cfcb6dd418 tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:32:59.864793 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-ddc38b02-90d8-4f4c-9a61-96cfcb6dd418 tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:32:59.865249 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-ddc38b02-90d8-4f4c-9a61-96cfcb6dd418 tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:32:59.865703 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-ddc38b02-90d8-4f4c-9a61-96cfcb6dd418 tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:32:59.876036 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [req-95665b84-87a5-4388-a63a-598aec8a29f4 req-685f086f-ab38-4fc5-b781-f12ea5a184f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "049da0e3-2e81-4b8a-81b5-ee690e3661b3", "tag": "813f9aa8-63ce-4634-bbde-692efe3b3973"}]} {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:32:59.890288 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [req-95665b84-87a5-4388-a63a-598aec8a29f4 req-685f086f-ab38-4fc5-b781-f12ea5a184f7 service nova] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:32:59.891612 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [req-95665b84-87a5-4388-a63a-598aec8a29f4 req-685f086f-ab38-4fc5-b781-f12ea5a184f7 service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:32:59.892240 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [req-95665b84-87a5-4388-a63a-598aec8a29f4 req-685f086f-ab38-4fc5-b781-f12ea5a184f7 service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:32:59.907219 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.compute.server_external_events [req-95665b84-87a5-4388-a63a-598aec8a29f4 req-685f086f-ab38-4fc5-b781-f12ea5a184f7 service nova] Creating event network-changed:813f9aa8-63ce-4634-bbde-692efe3b3973 for instance 049da0e3-2e81-4b8a-81b5-ee690e3661b3 on hv-cinder-86309 Oct 31 19:32:59.912031 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [req-95665b84-87a5-4388-a63a-598aec8a29f4 req-685f086f-ab38-4fc5-b781-f12ea5a184f7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041893 Oct 31 19:32:59.912777 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 552/1098] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 31 19:32:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:33:00.110012 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-ddc38b02-90d8-4f4c-9a61-96cfcb6dd418 tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d684a93ea334181be5af287d9fca534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9efd35f792404278b5122bc4bca1bf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:33:00.117825 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-ddc38b02-90d8-4f4c-9a61-96cfcb6dd418 tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] 10.222.0.16 "GET /compute/v2.1/servers/049da0e3-2e81-4b8a-81b5-ee690e3661b3" status: 200 len: 1313 microversion: 2.1 time: 0.269876 Oct 31 19:33:00.118261 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 547/1099] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:32:59 2022] GET /compute/v2.1/servers/049da0e3-2e81-4b8a-81b5-ee690e3661b3 => generated 1313 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:33:01.141765 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-c826c8ec-45d7-4e8b-98ff-0c79c4760a50 tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:33:01.142648 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-c826c8ec-45d7-4e8b-98ff-0c79c4760a50 tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] [instance: 049da0e3-2e81-4b8a-81b5-ee690e3661b3] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:33:01.149163 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-c826c8ec-45d7-4e8b-98ff-0c79c4760a50 tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:33:01.149684 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-c826c8ec-45d7-4e8b-98ff-0c79c4760a50 tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:33:01.150132 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-c826c8ec-45d7-4e8b-98ff-0c79c4760a50 tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:33:01.151020 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-c826c8ec-45d7-4e8b-98ff-0c79c4760a50 tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:33:01.151482 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-c826c8ec-45d7-4e8b-98ff-0c79c4760a50 tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:33:01.151909 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-c826c8ec-45d7-4e8b-98ff-0c79c4760a50 tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:33:01.282524 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-c826c8ec-45d7-4e8b-98ff-0c79c4760a50 tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d684a93ea334181be5af287d9fca534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9efd35f792404278b5122bc4bca1bf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:33:01.290573 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-c826c8ec-45d7-4e8b-98ff-0c79c4760a50 tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] 10.222.0.16 "GET /compute/v2.1/servers/049da0e3-2e81-4b8a-81b5-ee690e3661b3" status: 200 len: 1313 microversion: 2.1 time: 0.153038 Oct 31 19:33:01.291176 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 553/1100] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:33:01 2022] GET /compute/v2.1/servers/049da0e3-2e81-4b8a-81b5-ee690e3661b3 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:33:02.312849 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-2317a85f-6bfb-49c3-88e1-dfe2fcd391df tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:33:02.313454 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-2317a85f-6bfb-49c3-88e1-dfe2fcd391df tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] [instance: 049da0e3-2e81-4b8a-81b5-ee690e3661b3] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:33:02.319778 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-2317a85f-6bfb-49c3-88e1-dfe2fcd391df tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:33:02.320261 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-2317a85f-6bfb-49c3-88e1-dfe2fcd391df tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:33:02.320692 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-2317a85f-6bfb-49c3-88e1-dfe2fcd391df tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:33:02.321404 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-2317a85f-6bfb-49c3-88e1-dfe2fcd391df tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:33:02.321885 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-2317a85f-6bfb-49c3-88e1-dfe2fcd391df tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:33:02.322310 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-2317a85f-6bfb-49c3-88e1-dfe2fcd391df tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:33:02.447039 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-2317a85f-6bfb-49c3-88e1-dfe2fcd391df tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d684a93ea334181be5af287d9fca534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9efd35f792404278b5122bc4bca1bf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:33:02.454688 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-2317a85f-6bfb-49c3-88e1-dfe2fcd391df tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] 10.222.0.16 "GET /compute/v2.1/servers/049da0e3-2e81-4b8a-81b5-ee690e3661b3" status: 200 len: 1313 microversion: 2.1 time: 0.145727 Oct 31 19:33:02.455254 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 548/1101] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:33:02 2022] GET /compute/v2.1/servers/049da0e3-2e81-4b8a-81b5-ee690e3661b3 => generated 1313 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:33:03.477389 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-67bc5303-07c1-4f45-ae90-0bde2ede65eb tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:33:03.478029 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-67bc5303-07c1-4f45-ae90-0bde2ede65eb tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] [instance: 049da0e3-2e81-4b8a-81b5-ee690e3661b3] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:33:03.484991 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-67bc5303-07c1-4f45-ae90-0bde2ede65eb tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:33:03.485476 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-67bc5303-07c1-4f45-ae90-0bde2ede65eb tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:33:03.485942 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-67bc5303-07c1-4f45-ae90-0bde2ede65eb tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:33:03.486637 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-67bc5303-07c1-4f45-ae90-0bde2ede65eb tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:33:03.487095 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-67bc5303-07c1-4f45-ae90-0bde2ede65eb tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:33:03.487523 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-67bc5303-07c1-4f45-ae90-0bde2ede65eb tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:33:03.616767 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-67bc5303-07c1-4f45-ae90-0bde2ede65eb tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d684a93ea334181be5af287d9fca534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9efd35f792404278b5122bc4bca1bf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:33:03.625213 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-67bc5303-07c1-4f45-ae90-0bde2ede65eb tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] 10.222.0.16 "GET /compute/v2.1/servers/049da0e3-2e81-4b8a-81b5-ee690e3661b3" status: 200 len: 1313 microversion: 2.1 time: 0.151546 Oct 31 19:33:03.625704 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 554/1102] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:33:03 2022] GET /compute/v2.1/servers/049da0e3-2e81-4b8a-81b5-ee690e3661b3 => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:33:04.646707 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-3148619e-ba74-4b1c-b346-ced18cdcc70d tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:33:04.647313 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-3148619e-ba74-4b1c-b346-ced18cdcc70d tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] [instance: 049da0e3-2e81-4b8a-81b5-ee690e3661b3] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:33:04.653696 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-3148619e-ba74-4b1c-b346-ced18cdcc70d tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:33:04.654175 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-3148619e-ba74-4b1c-b346-ced18cdcc70d tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:33:04.654601 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-3148619e-ba74-4b1c-b346-ced18cdcc70d tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:33:04.655273 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-3148619e-ba74-4b1c-b346-ced18cdcc70d tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:33:04.655721 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-3148619e-ba74-4b1c-b346-ced18cdcc70d tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:33:04.656139 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-3148619e-ba74-4b1c-b346-ced18cdcc70d tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:33:04.784442 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-3148619e-ba74-4b1c-b346-ced18cdcc70d tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d684a93ea334181be5af287d9fca534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9efd35f792404278b5122bc4bca1bf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:33:04.792200 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-3148619e-ba74-4b1c-b346-ced18cdcc70d tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] 10.222.0.16 "GET /compute/v2.1/servers/049da0e3-2e81-4b8a-81b5-ee690e3661b3" status: 200 len: 1313 microversion: 2.1 time: 0.149325 Oct 31 19:33:04.792755 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 549/1103] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:33:04 2022] GET /compute/v2.1/servers/049da0e3-2e81-4b8a-81b5-ee690e3661b3 => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:33:05.800572 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [req-9ed6e616-bd65-44b7-b0d7-9b294f732a6f req-e3eb9e57-dd89-41eb-a430-303e1433d2e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "049da0e3-2e81-4b8a-81b5-ee690e3661b3", "name": "network-vif-plugged", "status": "completed", "tag": "813f9aa8-63ce-4634-bbde-692efe3b3973"}]} {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:33:05.815386 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-0afb8d00-5f1a-4e9e-95c1-aba420746caa tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:33:05.816091 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-0afb8d00-5f1a-4e9e-95c1-aba420746caa tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] [instance: 049da0e3-2e81-4b8a-81b5-ee690e3661b3] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:33:05.821005 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [req-9ed6e616-bd65-44b7-b0d7-9b294f732a6f req-e3eb9e57-dd89-41eb-a430-303e1433d2e4 service nova] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:33:05.821490 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [req-9ed6e616-bd65-44b7-b0d7-9b294f732a6f req-e3eb9e57-dd89-41eb-a430-303e1433d2e4 service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:33:05.821945 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [req-9ed6e616-bd65-44b7-b0d7-9b294f732a6f req-e3eb9e57-dd89-41eb-a430-303e1433d2e4 service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:33:05.822814 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-0afb8d00-5f1a-4e9e-95c1-aba420746caa tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:33:05.823381 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-0afb8d00-5f1a-4e9e-95c1-aba420746caa tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:33:05.823949 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-0afb8d00-5f1a-4e9e-95c1-aba420746caa tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:33:05.824661 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-0afb8d00-5f1a-4e9e-95c1-aba420746caa tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:33:05.825117 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-0afb8d00-5f1a-4e9e-95c1-aba420746caa tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:33:05.826364 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-0afb8d00-5f1a-4e9e-95c1-aba420746caa tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:33:05.833240 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.compute.server_external_events [req-9ed6e616-bd65-44b7-b0d7-9b294f732a6f req-e3eb9e57-dd89-41eb-a430-303e1433d2e4 service nova] Creating event network-vif-plugged:813f9aa8-63ce-4634-bbde-692efe3b3973 for instance 049da0e3-2e81-4b8a-81b5-ee690e3661b3 on hv-cinder-86309 Oct 31 19:33:05.838121 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [req-9ed6e616-bd65-44b7-b0d7-9b294f732a6f req-e3eb9e57-dd89-41eb-a430-303e1433d2e4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041423 Oct 31 19:33:05.838724 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 555/1104] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 31 19:33:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:33:05.963577 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-0afb8d00-5f1a-4e9e-95c1-aba420746caa tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d684a93ea334181be5af287d9fca534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9efd35f792404278b5122bc4bca1bf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:33:05.971117 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-0afb8d00-5f1a-4e9e-95c1-aba420746caa tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] 10.222.0.16 "GET /compute/v2.1/servers/049da0e3-2e81-4b8a-81b5-ee690e3661b3" status: 200 len: 1313 microversion: 2.1 time: 0.159663 Oct 31 19:33:05.971683 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 550/1105] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:33:05 2022] GET /compute/v2.1/servers/049da0e3-2e81-4b8a-81b5-ee690e3661b3 => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 19:33:06.994983 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-c02acc4f-da57-4dd2-87b2-a5127dcdfedc tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:33:06.995608 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-c02acc4f-da57-4dd2-87b2-a5127dcdfedc tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] [instance: 049da0e3-2e81-4b8a-81b5-ee690e3661b3] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:33:07.002211 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-c02acc4f-da57-4dd2-87b2-a5127dcdfedc tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:33:07.002693 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-c02acc4f-da57-4dd2-87b2-a5127dcdfedc tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:33:07.003127 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-c02acc4f-da57-4dd2-87b2-a5127dcdfedc tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:33:07.003816 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-c02acc4f-da57-4dd2-87b2-a5127dcdfedc tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:33:07.004271 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-c02acc4f-da57-4dd2-87b2-a5127dcdfedc tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:33:07.004695 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-c02acc4f-da57-4dd2-87b2-a5127dcdfedc tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:33:07.130913 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-c02acc4f-da57-4dd2-87b2-a5127dcdfedc tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d684a93ea334181be5af287d9fca534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9efd35f792404278b5122bc4bca1bf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:33:07.138475 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-c02acc4f-da57-4dd2-87b2-a5127dcdfedc tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] 10.222.0.16 "GET /compute/v2.1/servers/049da0e3-2e81-4b8a-81b5-ee690e3661b3" status: 200 len: 1497 microversion: 2.1 time: 0.148268 Oct 31 19:33:07.139040 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 556/1106] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:33:06 2022] GET /compute/v2.1/servers/049da0e3-2e81-4b8a-81b5-ee690e3661b3 => generated 1497 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 19:33:07.571404 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-44e901b5-7afa-4fe4-b018-bad7d92d634a tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:33:07.571919 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-44e901b5-7afa-4fe4-b018-bad7d92d634a tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] [instance: 049da0e3-2e81-4b8a-81b5-ee690e3661b3] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:33:07.578143 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-44e901b5-7afa-4fe4-b018-bad7d92d634a tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:33:07.578623 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-44e901b5-7afa-4fe4-b018-bad7d92d634a tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:33:07.579052 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-44e901b5-7afa-4fe4-b018-bad7d92d634a tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:33:07.579729 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-44e901b5-7afa-4fe4-b018-bad7d92d634a tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:33:07.580179 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-44e901b5-7afa-4fe4-b018-bad7d92d634a tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:33:07.580600 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-44e901b5-7afa-4fe4-b018-bad7d92d634a tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:33:07.606591 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-44e901b5-7afa-4fe4-b018-bad7d92d634a tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] [instance: 049da0e3-2e81-4b8a-81b5-ee690e3661b3] Going to try to terminate instance {{(pid=118727) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 19:33:07.678870 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-44e901b5-7afa-4fe4-b018-bad7d92d634a tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] 10.222.0.16 "DELETE /compute/v2.1/servers/049da0e3-2e81-4b8a-81b5-ee690e3661b3" status: 204 len: 0 microversion: 2.1 time: 0.110932 Oct 31 19:33:07.679434 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 551/1107] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 31 19:33:07 2022] DELETE /compute/v2.1/servers/049da0e3-2e81-4b8a-81b5-ee690e3661b3 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 19:33:07.687601 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [None req-cf673dd0-44ae-4bf4-8f9e-9fd092f875a5 tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Calling method '>' {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:33:07.688213 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.compute.api [None req-cf673dd0-44ae-4bf4-8f9e-9fd092f875a5 tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] [instance: 049da0e3-2e81-4b8a-81b5-ee690e3661b3] Fetching instance by UUID {{(pid=118726) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:33:07.690256 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG dbcounter [-] [118726] Writing DB stats nova_cell0:SELECT=2 {{(pid=118726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:33:07.690932 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG dbcounter [-] [118726] Writing DB stats nova_cell0:SELECT=6 {{(pid=118726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:33:07.696397 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-cf673dd0-44ae-4bf4-8f9e-9fd092f875a5 tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:33:07.696902 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-cf673dd0-44ae-4bf4-8f9e-9fd092f875a5 tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:33:07.697331 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-cf673dd0-44ae-4bf4-8f9e-9fd092f875a5 tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:33:07.698036 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-cf673dd0-44ae-4bf4-8f9e-9fd092f875a5 tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:33:07.698486 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-cf673dd0-44ae-4bf4-8f9e-9fd092f875a5 tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:33:07.698906 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [None req-cf673dd0-44ae-4bf4-8f9e-9fd092f875a5 tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:33:07.828359 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.policy [None req-cf673dd0-44ae-4bf4-8f9e-9fd092f875a5 tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d684a93ea334181be5af287d9fca534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9efd35f792404278b5122bc4bca1bf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118726) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:33:07.835956 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [None req-cf673dd0-44ae-4bf4-8f9e-9fd092f875a5 tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] 10.222.0.16 "GET /compute/v2.1/servers/049da0e3-2e81-4b8a-81b5-ee690e3661b3" status: 200 len: 1503 microversion: 2.1 time: 0.152148 Oct 31 19:33:07.836526 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 557/1108] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:33:07 2022] GET /compute/v2.1/servers/049da0e3-2e81-4b8a-81b5-ee690e3661b3 => generated 1503 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:33:08.859793 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-d74abd24-69ad-419e-a533-4a0d39b439ad tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:33:08.860490 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-d74abd24-69ad-419e-a533-4a0d39b439ad tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] [instance: 049da0e3-2e81-4b8a-81b5-ee690e3661b3] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:33:08.862387 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG dbcounter [-] [118727] Writing DB stats nova_cell0:SELECT=2 {{(pid=118727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 19:33:08.867799 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-d74abd24-69ad-419e-a533-4a0d39b439ad tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:33:08.868271 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-d74abd24-69ad-419e-a533-4a0d39b439ad tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:33:08.868699 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-d74abd24-69ad-419e-a533-4a0d39b439ad tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:33:08.869375 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-d74abd24-69ad-419e-a533-4a0d39b439ad tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:33:08.869853 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-d74abd24-69ad-419e-a533-4a0d39b439ad tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:33:08.870272 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-d74abd24-69ad-419e-a533-4a0d39b439ad tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:33:09.043382 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.policy [None req-d74abd24-69ad-419e-a533-4a0d39b439ad tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d684a93ea334181be5af287d9fca534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9efd35f792404278b5122bc4bca1bf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118727) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 19:33:09.052020 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-d74abd24-69ad-419e-a533-4a0d39b439ad tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] 10.222.0.16 "GET /compute/v2.1/servers/049da0e3-2e81-4b8a-81b5-ee690e3661b3" status: 200 len: 1503 microversion: 2.1 time: 0.196863 Oct 31 19:33:09.052544 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 552/1109] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:33:08 2022] GET /compute/v2.1/servers/049da0e3-2e81-4b8a-81b5-ee690e3661b3 => generated 1503 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 19:33:09.453190 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG nova.api.openstack.wsgi [req-e85609a2-a6a9-4f26-b6ca-0843f1e0fe8e req-61853443-4674-4649-ae7d-5186e7dd5c8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "049da0e3-2e81-4b8a-81b5-ee690e3661b3", "name": "network-vif-deleted", "tag": "813f9aa8-63ce-4634-bbde-692efe3b3973"}]} {{(pid=118726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 19:33:09.463445 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [req-e85609a2-a6a9-4f26-b6ca-0843f1e0fe8e req-61853443-4674-4649-ae7d-5186e7dd5c8b service nova] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:33:09.464027 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [req-e85609a2-a6a9-4f26-b6ca-0843f1e0fe8e req-61853443-4674-4649-ae7d-5186e7dd5c8b service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:33:09.464531 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: DEBUG oslo_concurrency.lockutils [req-e85609a2-a6a9-4f26-b6ca-0843f1e0fe8e req-61853443-4674-4649-ae7d-5186e7dd5c8b service nova] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:33:09.477431 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.compute.server_external_events [req-e85609a2-a6a9-4f26-b6ca-0843f1e0fe8e req-61853443-4674-4649-ae7d-5186e7dd5c8b service nova] Creating event network-vif-deleted:813f9aa8-63ce-4634-bbde-692efe3b3973 for instance 049da0e3-2e81-4b8a-81b5-ee690e3661b3 on hv-cinder-86309 Oct 31 19:33:09.482650 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: INFO nova.api.openstack.requestlog [req-e85609a2-a6a9-4f26-b6ca-0843f1e0fe8e req-61853443-4674-4649-ae7d-5186e7dd5c8b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033753 Oct 31 19:33:09.483418 dv-cinder-863097-1-iscsi devstack@n-api.service[118726]: [pid: 118726|app: 0|req: 558/1110] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 31 19:33:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 19:33:10.074053 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-c3d6af7d-be81-4f33-a3a6-27b1c80c5e3f tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Calling method '>' {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 19:33:10.074661 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.compute.api [None req-c3d6af7d-be81-4f33-a3a6-27b1c80c5e3f tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] [instance: 049da0e3-2e81-4b8a-81b5-ee690e3661b3] Fetching instance by UUID {{(pid=118727) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 19:33:10.080972 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-c3d6af7d-be81-4f33-a3a6-27b1c80c5e3f tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:33:10.081448 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-c3d6af7d-be81-4f33-a3a6-27b1c80c5e3f tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:33:10.081904 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-c3d6af7d-be81-4f33-a3a6-27b1c80c5e3f tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:33:10.082582 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-c3d6af7d-be81-4f33-a3a6-27b1c80c5e3f tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Acquiring lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 19:33:10.083029 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-c3d6af7d-be81-4f33-a3a6-27b1c80c5e3f tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 19:33:10.083447 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG oslo_concurrency.lockutils [None req-c3d6af7d-be81-4f33-a3a6-27b1c80c5e3f tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Lock "c28e7eb5-b4d6-491e-b19a-55ca88f41a3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 19:33:10.096750 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.wsgi [None req-c3d6af7d-be81-4f33-a3a6-27b1c80c5e3f tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] HTTP exception thrown: Instance 049da0e3-2e81-4b8a-81b5-ee690e3661b3 could not be found. Oct 31 19:33:10.098386 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-c3d6af7d-be81-4f33-a3a6-27b1c80c5e3f tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Request method failure captured: Oct 31 19:33:10.098386 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: request: GET /compute/v2.1/servers/049da0e3-2e81-4b8a-81b5-ee690e3661b3 HTTP/1.1 Oct 31 19:33:10.098386 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Accept: application/json Oct 31 19:33:10.098386 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Accept-Encoding: identity Oct 31 19:33:10.098386 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Connection: close Oct 31 19:33:10.098386 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Content-Length: 0 Oct 31 19:33:10.098386 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Content-Type: application/json Oct 31 19:33:10.098386 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Host: 10.222.0.16 Oct 31 19:33:10.098386 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: Openstack-System-Scope: None Oct 31 19:33:10.098386 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: User-Agent: python-urllib3/1.26.12 Oct 31 19:33:10.098386 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Auth-Token: gAAAAABjYCLaQh9UbohKWyj4LgOeohehcvKH8_saK3CxQtVNeAbYjO-eLfB04e4oj9Pt7s7b2A_x3qVULjqPTjaMd_4LR_YdU71n11-E5ArMUrZHbeVlzIKcXZX9yVFPY9OQFLLLMwZPRv719H40W-yzfpBMsOnJ3g4raPoCh_b7o7pxGKuVoT8 Oct 31 19:33:10.098386 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Domain-Id: None Oct 31 19:33:10.098386 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Domain-Name: None Oct 31 19:33:10.098386 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Identity-Status: Confirmed Oct 31 19:33:10.098386 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Is-Admin-Project: True Oct 31 19:33:10.098386 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Project-Domain-Id: default Oct 31 19:33:10.098386 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Project-Domain-Name: Default Oct 31 19:33:10.098386 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Project-Id: 9efd35f792404278b5122bc4bca1bf7c Oct 31 19:33:10.098386 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Project-Name: tempest-VolumesActionsTest-102418348 Oct 31 19:33:10.098386 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Role: member,reader Oct 31 19:33:10.098386 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Roles: member,reader Oct 31 19:33:10.100187 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9efd35f792404278b5122bc4bca1bf7c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9efd35f792404278b5122bc4bca1bf7c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9efd35f792404278b5122bc4bca1bf7c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9efd35f792404278b5122bc4bca1bf7c"}]}] Oct 31 19:33:10.100187 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Tenant: tempest-VolumesActionsTest-102418348 Oct 31 19:33:10.100187 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Tenant-Id: 9efd35f792404278b5122bc4bca1bf7c Oct 31 19:33:10.100187 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-Tenant-Name: tempest-VolumesActionsTest-102418348 Oct 31 19:33:10.100187 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User: tempest-VolumesActionsTest-102418348-project Oct 31 19:33:10.100187 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User-Domain-Id: default Oct 31 19:33:10.100187 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User-Domain-Name: Default Oct 31 19:33:10.100187 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User-Id: 5d684a93ea334181be5af287d9fca534 Oct 31 19:33:10.100187 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: X-User-Name: tempest-VolumesActionsTest-102418348-project Oct 31 19:33:10.100187 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: method: > Oct 31 19:33:10.100187 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: exception: Instance 049da0e3-2e81-4b8a-81b5-ee690e3661b3 could not be found. Oct 31 19:33:10.100187 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: action_args: {'id': '049da0e3-2e81-4b8a-81b5-ee690e3661b3'} Oct 31 19:33:10.101371 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: {{(pid=118727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 19:33:10.101371 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:33:10.101371 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 19:33:10.101371 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 19:33:10.101371 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 19:33:10.101371 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 19:33:10.101371 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 19:33:10.101371 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 19:33:10.101371 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 19:33:10.101371 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 19:33:10.101371 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 049da0e3-2e81-4b8a-81b5-ee690e3661b3 could not be found. Oct 31 19:33:10.101371 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:33:10.101371 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 19:33:10.101371 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:33:10.101371 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:33:10.101371 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 19:33:10.101371 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 19:33:10.101371 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 19:33:10.101371 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 19:33:10.101371 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 19:33:10.103726 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 19:33:10.103726 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 19:33:10.103726 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 19:33:10.103726 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 19:33:10.103726 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 19:33:10.103726 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 19:33:10.103726 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 19:33:10.103726 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 049da0e3-2e81-4b8a-81b5-ee690e3661b3 could not be found. Oct 31 19:33:10.103726 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:33:10.103726 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 19:33:10.103726 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:33:10.103726 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 19:33:10.103726 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 19:33:10.103726 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 19:33:10.103726 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 19:33:10.103726 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 19:33:10.103726 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 049da0e3-2e81-4b8a-81b5-ee690e3661b3 could not be found. Oct 31 19:33:10.103726 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: ERROR nova.api.openstack.wsgi Oct 31 19:33:10.105522 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: DEBUG nova.api.openstack.wsgi [None req-c3d6af7d-be81-4f33-a3a6-27b1c80c5e3f tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] Returning 404 to user: Instance 049da0e3-2e81-4b8a-81b5-ee690e3661b3 could not be found. {{(pid=118727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 19:33:10.105522 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: INFO nova.api.openstack.requestlog [None req-c3d6af7d-be81-4f33-a3a6-27b1c80c5e3f tempest-VolumesActionsTest-102418348 tempest-VolumesActionsTest-102418348-project] 10.222.0.16 "GET /compute/v2.1/servers/049da0e3-2e81-4b8a-81b5-ee690e3661b3" status: 404 len: 111 microversion: 2.1 time: 0.029593 Oct 31 19:33:10.105522 dv-cinder-863097-1-iscsi devstack@n-api.service[118727]: [pid: 118727|app: 0|req: 553/1111] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 31 19:33:10 2022] GET /compute/v2.1/servers/049da0e3-2e81-4b8a-81b5-ee690e3661b3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0)